Factual package intelligence from PyPI

coralbricks-gpu-inference 0.1.0 package intelligence

Production-grade gRPC GPU embedding inference server with token-bucket batching, backpressure, and torch.compile support.

pip install coralbricks-gpu-inference

Current version
0.1.0
Python requirement
>=3.10
License
Apache-2.0
Distribution type
Pure Python wheel
Release files
2 (1 wheels, 1 source)
Download size
74.6 KiB
Release history
1 releases with files
Median release cadence
Not enough dated releases

coralbricks-gpu-inference dependencies

PyPI declares 13 unique dependency rules for this release. Environment markers are shown when supplied by the project.

  1. grpcio >=1.60.0
  2. grpcio-tools >=1.60.0
  3. protobuf >=4.25.0
  4. torch >=2.5.0
  5. transformers >=4.40.0
  6. safetensors >=0.4.0
  7. numpy >=1.24.0
  8. huggingface-hub >=0.20.0

Compatibility and release files

coralbricks-gpu-inference publishes 1 wheel and 1 source archive for version 0.1.0. Wheel platform tags: any.

No version-specific Python classifiers are declared.

Release activity and sources

PyPI lists 1 release with files. The first dated release is ; 1 release falls within the 365 days preceding the latest dated release. The current release files were uploaded on .