Rare find

Blockwise-Parallel-Transformer. 32 times longer context window than vanilla Transformers and up to 4 times longer than memory efficient Transformers.

github.com/kyegomez/Blockwise-Parallel-Transformer
by @kyegomez

Problem

Audience

Keep exploring

Updates

No founder updates yet. Check back soon.