Megatron-LM. Ongoing research training transformer language models at scale, including: BERT

github.com/experiencor/Megatron-LM

Problem

Audience

Updates

No founder updates yet. Check back soon.