Factual package intelligence from PyPI
High-performance bpe tokenizer with C++ backend and Python bindings
pip install shatokenizer
PyPI declares 1 unique dependency rule for this release. Environment markers are shown when supplied by the project.
>=2.6.0shatokenizer publishes 0 wheels and 1 source archive for version 0.1.2. Wheel platform tags: No wheel platform tags.
No version-specific Python classifiers are declared.
PyPI lists 3 releases with files. The first dated release is ; 3 releases fall within the 365 days preceding the latest dated release. The current release files were uploaded on . The preceding dated release was .