Rare find

InfiniTransformer. Unofficial PyTorch/🤗Transformers(Gemma/Llama3) implementation of Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention

github.com/Beomi/InfiniTransformer
by @Beomi

Problem

Audience

Keep exploring

Updates

No founder updates yet. Check back soon.