Factual package intelligence from PyPI
TokenGeeX is an efficient tokenizer for code based on UnigramLM and TokenMonster.
pip install tokengeex
PyPI declares 0 unique dependency rules for this release. Environment markers are shown when supplied by the project.
This release declares no required runtime dependencies in its PyPI metadata.
tokengeex publishes 109 wheels and 0 source archives for version 1.1.0. Wheel platform tags: macosx_10_12_x86_64, macosx_11_0_arm64, manylinux_2_17_aarch64.manylinux2014_aarch64, manylinux_2_17_armv7l.manylinux2014_armv7l, manylinux_2_17_i686.manylinux2014_i686, manylinux_2_17_ppc64le.manylinux2014_ppc64le, manylinux_2_17_s390x.manylinux2014_s390x, manylinux_2_17_x86_64.manylinux2014_x86_64, musllinux_1_1_aarch64, musllinux_1_1_x86_64, win32, win_amd64.
No version-specific Python classifiers are declared.
PyPI lists 10 releases with files. The first dated release is ; 10 releases fall within the 365 days preceding the latest dated release. The current release files were uploaded on . The preceding dated release was .