SPES. Official Implementation for paper "Pretraining A Large Language Model using Distributed GPUs: A Memory-Efficient Decentralized Paradigm"

github.com/zjr2000/SPES

Problem

Audience

Updates

No founder updates yet. Check back soon.