csa. Calibrated Sparse Attention: a training-free inference-time procedure that reduces attention compute in pretrained transformers by an order of magnitude while preserving language-modeling quality.

github.com/jnormore/csa

Problem

Audience

Updates

No founder updates yet. Check back soon.