datatrove
huggingface/datatrove
Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.
3,155stars
Forks
279
Open issues
92
Watchers
3,155
Size
34.9 MB
PythonApache License 2.0
Created: Jun 14, 2023
Updated: Jul 13, 2026
Last push: Jul 3, 2026