KV-Compression. Implemented and benchmarked KV cache compression methods for LLM inference in Triton. Optimized kernels for KIVI and TurboQuant with Flash Attention integration - up to 7.11× compression on GPT-2 and 7.31× on Qwen3.5 9B.

github.com/Mog9/KV-Compression

Problem

Audience

Updates

No founder updates yet. Check back soon.