pre-training-for-dummies. Train GPT-2 from scratch on a single GPU. Companion code for the Pre-Training from Scratch book.

github.com/Infatoshi/pre-training-for-dummies
by @Infatoshi

Problem

Audience

Keep exploring

Updates

No founder updates yet. Check back soon.