Factual package intelligence from PyPI

turktoken 0.1.0 package intelligence

urkish-optimized BPE tokenizer with GPT-4 style pre-tokenization. Train, encode, decode with custom special tokens.

pip install turktoken

Current version
0.1.0
Python requirement
>=3.8
License
MIT
Distribution type
Pure Python wheel
Release files
2 (1 wheels, 1 source)
Download size
9.2 KiB
Release history
1 releases with files
Median release cadence
Not enough dated releases

turktoken dependencies

PyPI declares 1 unique dependency rule for this release. Environment markers are shown when supplied by the project.

  1. regex >=2022.1.18

Compatibility and release files

turktoken publishes 1 wheel and 1 source archive for version 0.1.0. Wheel platform tags: any.

Declared Python classifiers: 3.10, 3.11, 3.12, 3.8, 3.9.

Release activity and sources

PyPI lists 1 release with files. The first dated release is ; 1 release falls within the 365 days preceding the latest dated release. The current release files were uploaded on .