tik-tokenizer. .NET and Typescript implementation of BPE tokenizer for OpenAI LLMs.

github.com/mjbvz/tik-tokenizer
by @mjbvz

Problem

Audience

Keep exploring

Updates

No founder updates yet. Check back soon.