Factual package intelligence from PyPI

toklens 0.1.2 package intelligence

TokLens: Looking Beyond Fertility in Tokenizer Evaluation

pip install toklens

Current version
0.1.2
Python requirement
>=3.10
License
MIT
Distribution type
Pure Python wheel
Release files
2 (1 wheels, 1 source)
Download size
28.4 MiB
Release history
2 releases with files
Median release cadence
0 days

toklens dependencies

PyPI declares 19 unique dependency rules for this release. Environment markers are shown when supplied by the project.

  1. datasets >=2.0
  2. numpy >=1.24
  3. textalloc >=1.2.3
  4. tokenizers >=0.19

Compatibility and release files

toklens publishes 1 wheel and 1 source archive for version 0.1.2. Wheel platform tags: any.

Declared Python classifiers: 3.10, 3.11, 3.12.

Release activity and sources

PyPI lists 2 releases with files. The first dated release is ; 2 releases fall within the 365 days preceding the latest dated release. The current release files were uploaded on . The preceding dated release was .