Factual package intelligence from PyPI

turboquant-serve 0.1.2 package intelligence

TurboQuant KV-cache compression for any HuggingFace model

pip install turboquant-serve

Current version
0.1.2
Python requirement
>=3.10
License
MIT
Distribution type
Pure Python wheel
Release files
2 (1 wheels, 1 source)
Download size
66.9 KiB
Release history
3 releases with files
Median release cadence
0 days

turboquant-serve dependencies

PyPI declares 15 unique dependency rules for this release. Environment markers are shown when supplied by the project.

  1. torch >=2.3.0
  2. transformers >=4.51.0
  3. accelerate >=0.30.0
  4. bitsandbytes >=0.43.0
  5. fastapi >=0.111.0
  6. uvicorn >=0.29.0
  7. pydantic >=2.0.0
  8. huggingface_hub

Compatibility and release files

turboquant-serve publishes 1 wheel and 1 source archive for version 0.1.2. Wheel platform tags: any.

Declared Python classifiers: 3.10, 3.11, 3.12.

Release activity and sources

PyPI lists 3 releases with files. The first dated release is ; 3 releases fall within the 365 days preceding the latest dated release. The current release files were uploaded on . The preceding dated release was .