Rare find

Medusa. Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads

github.com/FasterDecoding/Medusa

Problem

Audience

Updates

No founder updates yet. Check back soon.