Factual package intelligence from PyPI

tokenizerbench 0.2.0 package intelligence

Benchmark tokenizers across 84 languages, 17 code languages, math formulas, and edge cases

pip install tokenizerbench

Current version
0.2.0
Python requirement
>=3.10
License
MIT
Distribution type
Pure Python wheel
Release files
2 (1 wheels, 1 source)
Download size
176.7 KiB
Release history
1 releases with files
Median release cadence
Not enough dated releases

tokenizerbench dependencies

PyPI declares 18 unique dependency rules for this release. Environment markers are shown when supplied by the project.

This release declares no required runtime dependencies in its PyPI metadata.

Compatibility and release files

tokenizerbench publishes 1 wheel and 1 source archive for version 0.2.0. Wheel platform tags: any.

No version-specific Python classifiers are declared.

Metadata completeness

PyPI does not currently declare: project URL. PyDeps marks these fields as unknown instead of guessing values.

Release activity and sources

PyPI lists 1 release with files. The first dated release is ; 1 release falls within the 365 days preceding the latest dated release. The current release files were uploaded on .

The project does not publish external project URLs in its PyPI metadata.