Rare find
rotorquant. KV cache compression via block-diagonal rotation. Beats TurboQuant: better PPL (6.91 vs 7.07), 28% faster decode, 5.3x faster prefill, 44x fewer params. Drop-in llama.cpp integration.
github.com/scrya-com/rotorquant
Problem
Audience
Updates
No founder updates yet. Check back soon.