Factual package intelligence from PyPI

datatools-py 0.5 package intelligence

Library and scripts for common LM data utilities (tokenizing, splitting, packing, ...)

pip install datatools-py

Current version
0.5
Python requirement
>=3.6
License
MIT License
Distribution type
Pure Python wheel
Release files
2 (1 wheels, 1 source)
Download size
47.2 KiB
Release history
5 releases with files
Median release cadence
29 days

datatools-py dependencies

PyPI declares 11 unique dependency rules for this release. Environment markers are shown when supplied by the project.

  1. tqdm >=4.66.1
  2. numpy >=1.26.4
  3. simple_parsing >=0.1.5
  4. mosaicml-streaming >=0.7.5
  5. sentencepiece >=0.1.99
  6. zstandard >=0.23.0
  7. universal-pathlib >=0.2.2
  8. fsspec >=2023.1.0
  9. pyarrow >=10.0.0

Compatibility and release files

datatools-py publishes 1 wheel and 1 source archive for version 0.5. Wheel platform tags: any.

No version-specific Python classifiers are declared.

Release activity and sources

PyPI lists 5 releases with files. The first dated release is ; 5 releases fall within the 365 days preceding the latest dated release. The current release files were uploaded on . The preceding dated release was .