Rare find

LightSeq. Official repository for DistFlashAttn: Distributed Memory-efficient Attention for Long-context LLMs Training

github.com/RulinShao/LightSeq
by @RulinShao

Problem

Audience

Keep exploring

Updates

No founder updates yet. Check back soon.