Rare find

SAGE. No Parameters Left Behind: Sensitivity Guided Adaptive Learning Rate for Training Large Transformer Models (ICLR 2022)

github.com/cliang1453/SAGE

Problem

Audience

Updates

No founder updates yet. Check back soon.