Factual package intelligence from PyPI

rabbitllm 1.1.0 package intelligence

Run 70B+ LLMs on a single 4GB GPU — no quantization required. Layer-streaming inference for consumer hardware.

pip install rabbitllm

Current version
1.1.0
Python requirement
>=3.10
License
MIT
Distribution type
Pure Python wheel
Release files
2 (1 wheels, 1 source)
Download size
344.9 KiB
Release history
3 releases with files
Median release cadence
3 days

rabbitllm dependencies

PyPI declares 15 unique dependency rules for this release. Environment markers are shown when supplied by the project.

  1. accelerate >=1.1.0
  2. bitsandbytes >=0.49.2
  3. einops >=0.8.2
  4. huggingface-hub >=0.20
  5. safetensors >=0.4
  6. scipy
  7. sentencepiece >=0.1.99
  8. tiktoken >=0.12.0
  9. torch <2.6,>=2.5
  10. tqdm
  11. transformers-stream-generator >=0.0.5
  12. transformers <5.3,>=5.0

Compatibility and release files

rabbitllm publishes 1 wheel and 1 source archive for version 1.1.0. Wheel platform tags: any.

No version-specific Python classifiers are declared.

Release activity and sources

PyPI lists 3 releases with files. The first dated release is ; 3 releases fall within the 365 days preceding the latest dated release. The current release files were uploaded on . The preceding dated release was .