Factual package intelligence from PyPI

tiktokenizer 0.1.1 package intelligence

Convert HuggingFace tokenizers to tiktoken format

pip install tiktokenizer

Current version
0.1.1
Python requirement
>=3.10
License
MIT
Distribution type
Pure Python wheel
Release files
2 (1 wheels, 1 source)
Download size
19.0 KiB
Release history
2 releases with files
Median release cadence
0 days

tiktokenizer dependencies

PyPI declares 3 unique dependency rules for this release. Environment markers are shown when supplied by the project.

  1. tiktoken >=0.12.0
  2. transformers >=4.57.3

Compatibility and release files

tiktokenizer publishes 1 wheel and 1 source archive for version 0.1.1. Wheel platform tags: any.

No version-specific Python classifiers are declared.

Release activity and sources

PyPI lists 2 releases with files. The first dated release is ; 2 releases fall within the 365 days preceding the latest dated release. The current release files were uploaded on . The preceding dated release was .