Factual package intelligence from PyPI

llmlingua 0.2.2 package intelligence

To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.

pip install llmlingua

Current version
0.2.2
Python requirement
>=3.8.0
License
MIT License
Distribution type
Pure Python wheel
Release files
2 (1 wheels, 1 source)
Download size
88.2 KiB
Release history
14 releases with files
Median release cadence
1 days

llmlingua dependencies

PyPI declares 24 unique dependency rules for this release. Environment markers are shown when supplied by the project.

  1. transformers >=4.26.0
  2. accelerate
  3. torch
  4. tiktoken
  5. nltk
  6. numpy

The compact report shows 18 of 24 declarations. The interactive dependency graph loads the complete metadata.

Compatibility and release files

llmlingua publishes 1 wheel and 1 source archive for version 0.2.2. Wheel platform tags: any.

No version-specific Python classifiers are declared.

Release activity and sources

PyPI lists 14 releases with files. The first dated release is ; 14 releases fall within the 365 days preceding the latest dated release. The current release files were uploaded on . The preceding dated release was .