Factual package intelligence from PyPI

vllm-acc 0.4.21716571491.2888474 package intelligence

A high-throughput and memory-efficient inference and serving engine for LLMs

pip install vllm-acc

Current version
0.4.21716571491.2888474
Python requirement
>=3.8
License
Apache 2.0
Distribution type
Includes compiled wheel
Release files
2 (1 wheels, 1 source)
Download size
44.8 MiB
Release history
8 releases with files
Median release cadence
0 days

vllm-acc dependencies

PyPI declares 28 unique dependency rules for this release. Environment markers are shown when supplied by the project.

  1. cmake >=3.21
  2. ninja
  3. psutil
  4. sentencepiece
  5. numpy
  6. requests
  7. py-cpuinfo
  8. transformers >=4.40.0
  9. tokenizers >=0.19.1
  10. fastapi
  11. aiohttp
  12. openai
  13. uvicorn
  14. pydantic >=2.0
  15. prometheus-client >=0.18.0
  16. prometheus-fastapi-instrumentator >=7.0.0
  17. tiktoken >=0.6.0
  18. lm-format-enforcer ==0.10.1

The compact report shows 18 of 28 declarations. The interactive dependency graph loads the complete metadata.

Compatibility and release files

vllm-acc publishes 1 wheel and 1 source archive for version 0.4.21716571491.2888474. Wheel platform tags: manylinux1_x86_64.

Declared Python classifiers: 3.10, 3.11, 3.8, 3.9.

Release activity and sources

PyPI lists 8 releases with files. The first dated release is ; 8 releases fall within the 365 days preceding the latest dated release. The current release files were uploaded on . The preceding dated release was .