Factual package intelligence from PyPI

kitoken 0.11.0 package intelligence

Fast tokenizer for language models, supporting BPE, Unigram and WordPiece tokenization

pip install kitoken

Current version
0.11.0
Python requirement
>=3.10
License
BSD-2-Clause
Distribution type
Includes compiled wheel
Release files
14 (13 wheels, 1 source)
Download size
31.2 MiB
Release history
3 releases with files
Median release cadence
255 days

kitoken dependencies

PyPI declares 0 unique dependency rules for this release. Environment markers are shown when supplied by the project.

This release declares no required runtime dependencies in its PyPI metadata.

Compatibility and release files

kitoken publishes 13 wheels and 1 source archive for version 0.11.0. Wheel platform tags: macosx_13_0_arm64, macosx_13_0_x86_64, manylinux_2_28_aarch64, manylinux_2_28_armv7l, manylinux_2_28_i686, manylinux_2_28_ppc64le, manylinux_2_28_x86_64, musllinux_1_2_aarch64, musllinux_1_2_armv7l, musllinux_1_2_i686, musllinux_1_2_x86_64, win32, win_amd64.

No version-specific Python classifiers are declared.

Release activity and sources

PyPI lists 3 releases with files. The first dated release is ; 2 releases fall within the 365 days preceding the latest dated release. The current release files were uploaded on . The preceding dated release was .