Factual package intelligence from PyPI

nextai-vllm 0.0.7 package intelligence

A high-throughput and memory-efficient inference and serving engine for LLMs

pip install nextai-vllm

Current version
0.0.7
Python requirement
>=3.8
License
Apache 2.0
Distribution type
Includes compiled wheel
Release files
2 (2 wheels, 0 source)
Download size
186.3 MiB
Release history
6 releases with files
Median release cadence
6 days

nextai-vllm dependencies

PyPI declares 20 unique dependency rules for this release. Environment markers are shown when supplied by the project.

  1. cmake >=3.21
  2. ninja
  3. psutil
  4. sentencepiece
  5. numpy
  6. requests
  7. py-cpuinfo
  8. transformers >=4.39.1
  9. fastapi
  10. uvicorn
  11. pydantic >=2.0
  12. prometheus-client >=0.18.0
  13. tiktoken ==0.6.0
  14. outlines ==0.0.34
  15. ray >=2.9
  16. pynvml ==11.5.0
  17. vllm-nccl-cu12 <2.19,>=2.18
  18. torch ==2.1.2

The compact report shows 18 of 20 declarations. The interactive dependency graph loads the complete metadata.

Compatibility and release files

nextai-vllm publishes 2 wheels and 0 source archives for version 0.0.7. Wheel platform tags: manylinux1_x86_64.

Declared Python classifiers: 3.10, 3.11, 3.8, 3.9.

Release activity and sources

PyPI lists 6 releases with files. The first dated release is ; 6 releases fall within the 365 days preceding the latest dated release. The current release files were uploaded on . The preceding dated release was .