Rare find

SwitchTransformers. Implementation of Switch Transformers from the paper: "Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity"

github.com/kyegomez/SwitchTransformers
by @kyegomez

Problem

Audience

Keep exploring

Updates

No founder updates yet. Check back soon.