LongShortTokenDecoding. Long short token decoding speed up 4x for long context LLM. A hundred lines of core code. Open source for learning.

github.com/66RING/LongShortTokenDecoding
by @66RING

Problem

Audience

Keep exploring

Updates

No founder updates yet. Check back soon.