Rare find

ReMoE. [ICLR2025] Codebase for "ReMoE: Fully Differentiable Mixture-of-Experts with ReLU Routing", built on Megatron-LM.

github.com/thu-ml/ReMoE

Problem

Audience

Updates

No founder updates yet. Check back soon.