Factual package intelligence from PyPI

gpe-tokenizer 0.1.6.4 package intelligence

Grapheme Pair Encoding Tokenizer for Sinhala Language

pip install gpe-tokenizer

Current version
0.1.6.4
Python requirement
<3.15,>=3.13
License
Not declared
Distribution type
Pure Python wheel
Release files
2 (1 wheels, 1 source)
Download size
1.1 MiB
Release history
8 releases with files
Median release cadence
0 days

gpe-tokenizer dependencies

PyPI declares 8 unique dependency rules for this release. Environment markers are shown when supplied by the project.

  1. datasets <5.0.0,>=4.2.0
  2. grapheme <0.7.0,>=0.6.0
  3. huggingface-hub <0.36.0,>=0.35.3
  4. joblib <2.0.0,>=1.5.2
  5. regex <2026.0.0,>=2025.9.18
  6. tokenizers >=0.22.1
  7. torch <3.0.0,>=2.9.0
  8. transformers <5.0.0,>=4.57.1

Compatibility and release files

gpe-tokenizer publishes 1 wheel and 1 source archive for version 0.1.6.4. Wheel platform tags: any.

Declared Python classifiers: 3.13, 3.14.

Metadata completeness

PyPI does not currently declare: license, project URL. PyDeps marks these fields as unknown instead of guessing values.

Release activity and sources

PyPI lists 8 releases with files. The first dated release is ; 8 releases fall within the 365 days preceding the latest dated release. The current release files were uploaded on . The preceding dated release was .

The project does not publish external project URLs in its PyPI metadata.