Factual package intelligence from PyPI

bytetok 0.3.0 package intelligence

A fast, modular and light-weight BPE tokenizer for NLP research and prototyping.

pip install bytetok

Current version
0.3.0
Python requirement
>=3.12
License
MIT
Distribution type
Includes compiled wheel
Release files
6 (5 wheels, 1 source)
Download size
6.3 MiB
Release history
6 releases with files
Median release cadence
9 days

bytetok dependencies

PyPI declares 1 unique dependency rule for this release. Environment markers are shown when supplied by the project.

  1. regex

Compatibility and release files

bytetok publishes 5 wheels and 1 source archive for version 0.3.0. Wheel platform tags: macosx_10_12_x86_64, macosx_11_0_arm64, manylinux_2_17_aarch64.manylinux2014_aarch64, manylinux_2_17_x86_64.manylinux2014_x86_64, win_amd64.

Declared Python classifiers: 3.12, 3.13, 3.14.

Release activity and sources

PyPI lists 6 releases with files. The first dated release is ; 6 releases fall within the 365 days preceding the latest dated release. The current release files were uploaded on . The preceding dated release was .