Rare find

datatrove. Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.

github.com/huggingface/datatrove
by @huggingface

Problem

Audience

Keep exploring

Updates

No founder updates yet. Check back soon.