attention_with_linear_biases. Code for the ALiBi method for transformer language models (ICLR 2022)

github.com/radarFudan/attention_with_linear_biases

Problem

Audience

Updates

No founder updates yet. Check back soon.