minbpe. Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.

github.com/dsdanielpark/minbpe
by @dsdanielpark

Problem

Audience

Keep exploring

Updates

No founder updates yet. Check back soon.