Yushun Zhang

Advanced
@zyushun

PhD student at the Chinese University of Hong Kong, Shenzhen, China https://zyushun.github.io/

zyushun.github.io/

Adam-mini. Code for Adam-mini: Use Fewer Learning Rates To Gain More https://arxiv.org/abs/2406.16793

458

hessian-spectrum. Code for the paper: Why Transformers Need Adam: A Hessian Perspective

65

Hessian-structure. Python

13
3
Apply