Rare find

MagiAttention. A Distributed Attention Towards Linear Scalability for Ultra-Long Context, Heterogeneous Data Training

github.com/SandAI-org/MagiAttention

Problem

Audience

Updates

No founder updates yet. Check back soon.