datatrove
huggingface/datatrove
Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.
3,304stars
Forks
292
Open issues
96
Watchers
3,304
Size
36.2 MB
PythonApache License 2.0
Created: Jun 14, 2023
Updated: Aug 25, 2026
Last push: Aug 13, 2026