Rare find

tokenx. ๐Ÿ“ Fast token estimation at 96% accuracy of a full tokenizer in a 2kB bundle

github.com/johannschopplich/tokenx

Problem

Audience

Updates

No founder updates yet. Check back soon.