Megatron-MoE-ModelZoo. Best practices for testing advanced Mixtral, DeepSeek, and Qwen series MoE models using Megatron Core MoE.
github.com/ISEEKYAN/Megatron-MoE-ModelZoo
Problem
Audience
Updates
No founder updates yet. Check back soon.
Problem
Audience