bpe-cpp. implementation of Byte-Pair Encoding (BPE) for subword tokenization, written entirely in C++ . The tokenizer learns merges from raw text and supports encoding/decoding with UTF-8

github.com/mrinalxdev/bpe-cpp

Problem

Audience

Updates

No founder updates yet. Check back soon.