InfiniTransformer. Unofficial PyTorch/🤗Transformers(Gemma/Llama3) implementation of Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention

github.com/Blaizzy/InfiniTransformer
by @Blaizzy

Problem

Audience

Keep exploring

Updates

No founder updates yet. Check back soon.