SimSMoE. Code for this paper "SimSMoE: Toward Efficient Training Mixture of Experts via Solving Representational Collapse".

github.com/giangdip2410/SimSMoE

Problem

Audience

Updates

No founder updates yet. Check back soon.