Rare find

Megatron-DeepSpeed. Ongoing research training transformer language models at scale, including: BERT & GPT-2

github.com/deepspeedai/Megatron-DeepSpeed
by @deepspeedai

Problem

Audience

Keep exploring

Updates

No founder updates yet. Check back soon.