Factual package intelligence from PyPI

npu-vllm 0.4.2.post3 package intelligence

A high-throughput and memory-efficient inference and serving engine for LLMs

pip install npu-vllm

Current version
0.4.2.post3
Python requirement
>=3.8
License
Apache 2.0
Distribution type
Pure Python wheel
Release files
2 (1 wheels, 1 source)
Download size
53.2 KiB
Release history
3 releases with files
Median release cadence
0 days

npu-vllm dependencies

PyPI declares 13 unique dependency rules for this release. Environment markers are shown when supplied by the project.

  1. numpy
  2. decorator
  3. attrs
  4. psutil
  5. absl-py
  6. cloudpickle
  7. scipy
  8. tornado
  9. transformers
  10. accelerate
  11. pandas
  12. torch ==2.1.0
  13. torch-npu ==2.1.0.post10

Compatibility and release files

npu-vllm publishes 1 wheel and 1 source archive for version 0.4.2.post3. Wheel platform tags: any.

Declared Python classifiers: 3.10, 3.11, 3.8, 3.9.

Release activity and sources

PyPI lists 3 releases with files. The first dated release is ; 3 releases fall within the 365 days preceding the latest dated release. The current release files were uploaded on . The preceding dated release was .