Factual package intelligence from PyPI

tilearn-infer 0.3.3 package intelligence

A high-throughput and memory-efficient inference and serving engine for LLMs

pip install tilearn-infer

Current version
0.3.3
Python requirement
>=3.8
License
Apache 2.0
Distribution type
Pure Python wheel
Release files
1 (1 wheels, 0 source)
Download size
50.8 MiB
Release history
3 releases with files
Median release cadence
6 days

tilearn-infer dependencies

PyPI declares 17 unique dependency rules for this release. Environment markers are shown when supplied by the project.

  1. cmake >=3.21
  2. ninja
  3. psutil
  4. ray >=2.9
  5. sentencepiece
  6. numpy
  7. torch ==2.1.2
  8. transformers >=4.39.1
  9. xformers ==0.0.23.post1
  10. fastapi
  11. uvicorn
  12. pydantic >=2.0
  13. prometheus-client >=0.18.0
  14. pynvml ==11.5.0
  15. triton >=2.1.0
  16. outlines ==0.0.34
  17. cupy-cuda12x ==12.1.0

Compatibility and release files

tilearn-infer publishes 1 wheel and 0 source archives for version 0.3.3. Wheel platform tags: any.

Declared Python classifiers: 3.10, 3.11, 3.8, 3.9.

Release activity and sources

PyPI lists 3 releases with files. The first dated release is ; 3 releases fall within the 365 days preceding the latest dated release. The current release files were uploaded on . The preceding dated release was .