Factual package intelligence from PyPI

vllm-consul 0.2.1 package intelligence

A high-throughput and memory-efficient inference and serving engine for LLMs

pip install vllm-consul

Current version
0.2.1
Python requirement
>=3.8
License
Apache 2.0
Distribution type
Includes compiled wheel
Release files
2 (1 wheels, 1 source)
Download size
22.3 MiB
Release history
5 releases with files
Median release cadence
0 days

vllm-consul dependencies

PyPI declares 16 unique dependency rules for this release. Environment markers are shown when supplied by the project.

  1. ninja
  2. psutil
  3. ray >=2.5.1
  4. pandas
  5. pyarrow
  6. sentencepiece
  7. numpy
  8. torch ==2.0.1
  9. transformers >=4.34.0
  10. xformers ==0.0.22
  11. fastapi
  12. uvicorn
  13. pydantic ==1.10.13
  14. python-consul
  15. fschat
  16. python-json-logger

Compatibility and release files

vllm-consul publishes 1 wheel and 1 source archive for version 0.2.1. Wheel platform tags: manylinux1_x86_64.

Declared Python classifiers: 3.10, 3.11, 3.8, 3.9.

Release activity and sources

PyPI lists 5 releases with files. The first dated release is ; 5 releases fall within the 365 days preceding the latest dated release. The current release files were uploaded on . The preceding dated release was .