Rare find

MagicDec. [ICLR2025] Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding

github.com/Infini-AI-Lab/MagicDec

Problem

Audience

Updates

No founder updates yet. Check back soon.