Factual package intelligence from PyPI

tokenizer 3.6.4 package intelligence

A fast, compact pure-Python tokenizer for Icelandic text with sentence segmentation

pip install tokenizer

Current version
3.6.4
Python requirement
>=3.10
License
MIT
Distribution type
Pure Python wheel
Release files
2 (1 wheels, 1 source)
Download size
214.3 KiB
Release history
65 releases with files
Median release cadence
23 days

tokenizer dependencies

PyPI declares 7 unique dependency rules for this release. Environment markers are shown when supplied by the project.

This release declares no required runtime dependencies in its PyPI metadata.

Compatibility and release files

tokenizer publishes 1 wheel and 1 source archive for version 3.6.4. Wheel platform tags: any.

Declared Python classifiers: 3.10, 3.11, 3.12, 3.13, 3.14.

Security snapshot for tokenizer 3.6.4

An OSV query completed on and found 0 known vulnerabilities affecting this version. 0 advisories are classified as critical. 0 advisories appear in the CISA Known Exploited Vulnerabilities catalog.

Release activity and sources

PyPI lists 65 releases with files. The first dated release is ; 10 releases fall within the 365 days preceding the latest dated release. The current release files were uploaded on . The preceding dated release was .