Rare find

SmallInitEmb. LayerNorm(SmallInit(Embedding)) in a Transformer to improve convergence

github.com/BlinkDL/SmallInitEmb
by @BlinkDL

Problem

Audience

Keep exploring

Updates

No founder updates yet. Check back soon.