Factual package intelligence from PyPI

local-llm-server 0.37.2 package intelligence

ローカルLLM（mlx / mlx-vlm / llama.cpp / vLLM / SGLang）を OpenAI 互換 API で束ねるマルチモデルゲートウェイ（サーバー）。gateway.toml のカタログを 1 ポートで配信し、model で振り分け・遅延起動・LRU 退避・MTP 高速化（Ollama 流の共有デーモン）。接続用クライアントは別パッケージ local-llm-client。

pip install local-llm-server

Current version
0.37.2
Python requirement
>=3.11
License
Apache-2.0
Distribution type
Pure Python wheel
Release files
2 (1 wheels, 1 source)
Download size
356.9 KiB
Release history
43 releases with files
Median release cadence
0 days

local-llm-server dependencies

PyPI declares 10 unique dependency rules for this release. Environment markers are shown when supplied by the project.

  1. psutil >=5.9
  2. mlx-lm >=0.31.3 when sys_platform == "darwin" and platform_machine == "arm64"
  3. mlx-vlm >=0.6.7 when sys_platform == "darwin" and platform_machine == "arm64"
  4. transformers >=5.14
  5. mlx-whisper >=0.4.3 when sys_platform == "darwin" and platform_machine == "arm64"
  6. imageio-ffmpeg >=0.4.9
  7. pillow >=10
  8. pyobjc-framework-Cocoa >=10 when sys_platform == "darwin"

Compatibility and release files

local-llm-server publishes 1 wheel and 1 source archive for version 0.37.2. Wheel platform tags: any.

Declared Python classifiers: 3.11, 3.12.

Security snapshot for local-llm-server 0.37.2

An OSV query completed on and found 0 known vulnerabilities affecting this version. 0 advisories are classified as critical. 0 advisories appear in the CISA Known Exploited Vulnerabilities catalog.

Release activity and sources

PyPI lists 43 releases with files. The first dated release is ; 43 releases fall within the 365 days preceding the latest dated release. The current release files were uploaded on . The preceding dated release was .