looped-moe. code for "Tying the Loop - Tied Expert Layers in Mixture-of-Experts Language Models"

github.com/epfml/looped-moe
by @epfml

Problem

Audience

Keep exploring

Updates

No founder updates yet. Check back soon.