Rare find

turboquant. TurboQuant: Near-optimal KV cache quantization for LLM inference (3-bit keys, 2-bit values) with Triton kernels + vLLM integration

github.com/0xSero/turboquant

Problem

Audience

Updates

No founder updates yet. Check back soon.