Factual package intelligence from PyPI

toke-tokenizer 0.1.0 package intelligence

BPE tokenizer for the toke programming language (16K vocab)

pip install toke-tokenizer

Current version
0.1.0
Python requirement
>=3.10
License
MIT
Distribution type
Pure Python wheel
Release files
2 (1 wheels, 1 source)
Download size
526.3 KiB
Release history
1 releases with files
Median release cadence
Not enough dated releases

toke-tokenizer dependencies

PyPI declares 2 unique dependency rules for this release. Environment markers are shown when supplied by the project.

This release declares no required runtime dependencies in its PyPI metadata.

Compatibility and release files

toke-tokenizer publishes 1 wheel and 1 source archive for version 0.1.0. Wheel platform tags: any.

Declared Python classifiers: 3.10, 3.11, 3.12.

Release activity and sources

PyPI lists 1 release with files. The first dated release is ; 1 release falls within the 365 days preceding the latest dated release. The current release files were uploaded on .