Rare find

tiktoken-rs. Ready-made tokenizer library for working with GPT and tiktoken

github.com/zurawiki/tiktoken-rs
by @zurawiki

Problem

Audience

Keep exploring

Updates

No founder updates yet. Check back soon.