memory_efficient_attention.pytorch. A human-readable PyTorch implementation of "Self-attention Does Not Need O(n^2) Memory" (Rabe&Staats'21).

github.com/moskomule/memory_efficient_attention.pytorch
by @moskomule

Problem

Audience

Keep exploring

Updates

No founder updates yet. Check back soon.