Factual package intelligence from PyPI
Fast BPE tokenizer/trainer with a Rust core and Python bindings
pip install uni-tokenizer
PyPI declares 1 unique dependency rule for this release. Environment markers are shown when supplied by the project.
>=1.26uni-tokenizer publishes 3 wheels and 1 source archive for version 0.1.6. Wheel platform tags: macosx_11_0_arm64, manylinux_2_17_x86_64.manylinux2014_x86_64, win_amd64.
No version-specific Python classifiers are declared.
An OSV query completed on and found 0 known vulnerabilities affecting this version. 0 advisories are classified as critical. 0 advisories appear in the CISA Known Exploited Vulnerabilities catalog.
PyPI does not currently declare: license. PyDeps marks these fields as unknown instead of guessing values.
PyPI lists 7 releases with files. The first dated release is ; 7 releases fall within the 365 days preceding the latest dated release. The current release files were uploaded on . The preceding dated release was .