tiktoken-go. Pure Go implementation of OpenAI's tiktoken tokenizer

github.com/j178/tiktoken-go
by @j178

Problem

Audience

Keep exploring

Updates

No founder updates yet. Check back soon.