datatrove
huggingface/datatrove
Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.
3,379stars
Forks
311
Open issues
116
Watchers
3,379
Size
35.3 MB
PythonApache License 2.0
Created: Jun 14, 2023
Updated: Oct 10, 2026
Last push: Oct 6, 2026