Rare find

tokenizers-cpp. Universal cross-platform tokenizers binding to HF and sentencepiece

github.com/mlc-ai/tokenizers-cpp
by @mlc-ai

Problem

Audience

Keep exploring

Updates

No founder updates yet. Check back soon.