Medusa. Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads

github.com/Narsil/Medusa
by @Narsil

Problem

Audience

Keep exploring

Updates

No founder updates yet. Check back soon.