Factual package intelligence from PyPI

rust-ai-serving-engine 0.1.5 package intelligence

Local GGUF model serving engine (pure-Rust Candle) — chat-template generation, token streaming, session cache, and an OpenAI-compatible API with a Python binding.

pip install rust-ai-serving-engine

Current version
0.1.5
Python requirement
>=3.9
License
Apache-2.0
Distribution type
Includes compiled wheel
Release files
6 (5 wheels, 1 source)
Download size
31.2 MiB
Release history
6 releases with files
Median release cadence
1 days

rust-ai-serving-engine dependencies

PyPI declares 0 unique dependency rules for this release. Environment markers are shown when supplied by the project.

This release declares no required runtime dependencies in its PyPI metadata.

Compatibility and release files

rust-ai-serving-engine publishes 5 wheels and 1 source archive for version 0.1.5. Wheel platform tags: macosx_10_12_x86_64, macosx_11_0_arm64, manylinux_2_17_aarch64.manylinux2014_aarch64, manylinux_2_17_x86_64.manylinux2014_x86_64, win_amd64.

No version-specific Python classifiers are declared.

Security snapshot for rust-ai-serving-engine 0.1.5

An OSV query completed on and found 0 known vulnerabilities affecting this version. 0 advisories are classified as critical. 0 advisories appear in the CISA Known Exploited Vulnerabilities catalog.

Release activity and sources

PyPI lists 6 releases with files. The first dated release is ; 6 releases fall within the 365 days preceding the latest dated release. The current release files were uploaded on . The preceding dated release was .