Factual package intelligence from PyPI

flexgen 0.1.8 package intelligence

Running large language models like OPT-175B/GPT-3 on a single GPU. Focusing on high-throughput large-batch generation.

pip install flexgen

Current version
0.1.8
Python requirement
>=3.7
License
Apache Software License
Distribution type
Pure Python wheel
Release files
2 (1 wheels, 1 source)
Download size
234.9 KiB
Release history
8 releases with files
Median release cadence
0 days

flexgen dependencies

PyPI declares 6 unique dependency rules for this release. Environment markers are shown when supplied by the project.

  1. torch >=1.12
  2. transformers >=4.24
  3. numpy
  4. tqdm
  5. pulp
  6. attrs

Compatibility and release files

flexgen publishes 1 wheel and 1 source archive for version 0.1.8. Wheel platform tags: any.

No version-specific Python classifiers are declared.

Release activity and sources

PyPI lists 8 releases with files. The first dated release is ; 8 releases fall within the 365 days preceding the latest dated release. The current release files were uploaded on . The preceding dated release was .