ssd. A low-latency inference engine supporting speculative speculative decoding (SSD).

github.com/tanishqkumar/ssd
by @tanishqkumar

Problem

Audience

Keep exploring

Updates

No founder updates yet. Check back soon.