Package data summary

tokenizers 0.23.1 package intelligence

PyPI does not currently provide a summary for tokenizers.

pip install tokenizers

Current version
0.23.1
Python requirement
>=3.10
License
Apache Software License
Distribution type
Includes compiled wheel
Release files
17 (16 wheels, 1 source)
Download size
74.8 MiB
Release history
100 releases with files
Median release cadence
7 days

tokenizers dependencies

PyPI declares 12 unique dependency rules for this release. Environment markers are shown when supplied by the project.

The compact report shows 8 of 12 declarations. The interactive dependency graph loads the complete metadata.

Compatibility and release files

tokenizers publishes 16 wheels and 1 source archive for version 0.23.1. Wheel platform tags: macosx_10_12_x86_64, macosx_11_0_arm64, manylinux_2_17_aarch64.manylinux2014_aarch64, manylinux_2_17_armv7l.manylinux2014_armv7l, manylinux_2_17_i686.manylinux2014_i686, manylinux_2_17_ppc64le.manylinux2014_ppc64le, manylinux_2_17_s390x.manylinux2014_s390x, manylinux_2_17_x86_64.manylinux2014_x86_64, manylinux_2_31_riscv64, musllinux_1_2_aarch64, musllinux_1_2_armv7l, musllinux_1_2_i686, musllinux_1_2_x86_64, win32, win_amd64, win_arm64.

Declared Python classifiers: 3.10, 3.11, 3.12, 3.13, 3.14.

Security snapshot for tokenizers 0.23.1

An OSV query completed on and found 0 known vulnerabilities affecting this version. 0 advisories are classified as critical. 0 advisories appear in the CISA Known Exploited Vulnerabilities catalog.

Packages that depend on tokenizers

deps.dev reports 456 direct and 6166 total known dependents for version 0.23.1, checked on .

Metadata completeness

PyPI does not currently declare: meaningful summary. PyDeps marks these fields as unknown instead of guessing values.

Release activity and sources

PyPI lists 100 releases with files. The first dated release is ; 12 releases fall within the 365 days preceding the latest dated release. The current release files were uploaded on . The preceding dated release was .

2 historical releases are fully yanked in PyPI metadata.