Rare find

mixture-of-experts. A Pytorch implementation of Sparsely-Gated Mixture of Experts, for massively increasing the parameter count of language models

github.com/lucidrains/mixture-of-experts
by @lucidrains

Problem

Audience

Keep exploring

Updates

No founder updates yet. Check back soon.