Factual package intelligence from PyPI

ommi-llm 0.2.3 package intelligence

Run 70B+ LLMs on consumer GPUs with layer-wise inference

pip install ommi-llm

Current version
0.2.3
Python requirement
>=3.10
License
MIT
Distribution type
Pure Python wheel
Release files
2 (1 wheels, 1 source)
Download size
83.1 KiB
Release history
5 releases with files
Median release cadence
0 days

ommi-llm dependencies

PyPI declares 20 unique dependency rules for this release. Environment markers are shown when supplied by the project.

  1. accelerate >=0.24.0
  2. bitsandbytes >=0.41.0
  3. huggingface-hub >=0.19.0
  4. mcp >=0.1.0
  5. numpy >=1.24.0
  6. psutil >=5.9.0
  7. pydantic >=2.0.0
  8. pyyaml >=6.0
  9. rich >=13.0.0
  10. safetensors >=0.4.0
  11. torch >=2.0.0
  12. tqdm >=4.65.0
  13. transformers >=4.35.0
  14. typer >=0.9.0

The compact report shows 18 of 20 declarations. The interactive dependency graph loads the complete metadata.

Compatibility and release files

ommi-llm publishes 1 wheel and 1 source archive for version 0.2.3. Wheel platform tags: any.

Declared Python classifiers: 3.10, 3.11, 3.12, 3.9.

Release activity and sources

PyPI lists 5 releases with files. The first dated release is ; 5 releases fall within the 365 days preceding the latest dated release. The current release files were uploaded on . The preceding dated release was .