tokenizer. Simple tokenizer based on re2c for NLP tasks

github.com/tuzzeg/tokenizer

Problem

Audience

Updates

No founder updates yet. Check back soon.