Factual package intelligence from PyPI

bp-tokenizer 1.0.2 package intelligence

A high-performance Python tokenizer using Byte-Pair Encoding (BPE) with 100k vocabulary, supporting text encoding, decoding, and normalization for NLP applications.

pip install bp-tokenizer

Current version
1.0.2
Python requirement
>=3.9
License
MIT
Distribution type
Pure Python wheel
Release files
2 (1 wheels, 1 source)
Download size
1.4 MiB
Release history
3 releases with files
Median release cadence
0 days

bp-tokenizer dependencies

PyPI declares 0 unique dependency rules for this release. Environment markers are shown when supplied by the project.

This release declares no required runtime dependencies in its PyPI metadata.

Compatibility and release files

bp-tokenizer publishes 1 wheel and 1 source archive for version 1.0.2. Wheel platform tags: any.

No version-specific Python classifiers are declared.

Release activity and sources

PyPI lists 3 releases with files. The first dated release is ; 3 releases fall within the 365 days preceding the latest dated release. The current release files were uploaded on . The preceding dated release was .