Rare find

LLMSpeculativeSampling. Fast inference from large lauguage models via speculative decoding

github.com/feifeibear/LLMSpeculativeSampling
by @feifeibear

Problem

Audience

Keep exploring

Updates

No founder updates yet. Check back soon.