gpt-2. Train 774M, 1.5B models with the Google's S3 optimizer

github.com/sdan/gpt-2

Problem

Audience

Updates

No founder updates yet. Check back soon.