Factual package intelligence from PyPI

nm-vllm 0.6.3.0 package intelligence

A high-throughput and memory-efficient inference and serving engine for LLMs

pip install nm-vllm

Current version
0.6.3.0
Python requirement
>=3.8
License
Neural Magic Enterprise License
Distribution type
Includes compiled wheel
Release files
1 (1 wheels, 0 source)
Download size
186.2 MiB
Release history
7 releases with files
Median release cadence
32 days

nm-vllm dependencies

PyPI declares 43 unique dependency rules for this release. Environment markers are shown when supplied by the project.

  1. psutil
  2. sentencepiece
  3. numpy <2.0.0
  4. requests >=2.26.0
  5. tqdm
  6. py-cpuinfo
  7. transformers >=4.45.0
  8. tokenizers >=0.19.1
  9. protobuf
  10. aiohttp
  11. openai >=1.40.0
  12. uvicorn

The compact report shows 12 of 43 declarations. The interactive dependency graph loads the complete metadata.

Compatibility and release files

nm-vllm publishes 1 wheel and 0 source archives for version 0.6.3.0. Wheel platform tags: manylinux_2_17_x86_64.

Declared Python classifiers: 3.10, 3.11, 3.12, 3.8, 3.9.

Release activity and sources

PyPI lists 7 releases with files. The first dated release is ; 7 releases fall within the 365 days preceding the latest dated release. The current release files were uploaded on . The preceding dated release was .