Factual package intelligence from PyPI

gllm-rt 0.0.6.post1 package intelligence

A high-throughput and memory-efficient inference and serving engine for LLMs

pip install gllm-rt

Current version
0.0.6.post1
Python requirement
>=3.9
License
Apache 2.0
Distribution type
Pure Python wheel
Release files
1 (1 wheels, 0 source)
Download size
223.1 KiB
Release history
1 releases with files
Median release cadence
Not enough dated releases

gllm-rt dependencies

PyPI declares 16 unique dependency rules for this release. Environment markers are shown when supplied by the project.

  1. pydantic >=2.11.7
  2. numpy
  3. tqdm
  4. transformers <5,>=4.55.2
  5. fastapi >=0.115.0
  6. openai >=1.99.1
  7. logger
  8. torch ==2.9.1
  9. torchvision ==0.24.1
  10. zmq
  11. aiohttp
  12. datasets
  13. pillow
  14. einops
  15. av
  16. sgl-kernel ==0.3.21

Compatibility and release files

gllm-rt publishes 1 wheel and 0 source archives for version 0.0.6.post1. Wheel platform tags: any.

No version-specific Python classifiers are declared.

Metadata completeness

PyPI does not currently declare: project URL. PyDeps marks these fields as unknown instead of guessing values.

Release activity and sources

PyPI lists 1 release with files. The first dated release is ; 1 release falls within the 365 days preceding the latest dated release. The current release files were uploaded on .

The project does not publish external project URLs in its PyPI metadata.