Rare find

GELUs. A smoother activation function (undergrad code)

github.com/hendrycks/GELUs
by @hendrycks

Problem

Audience

Keep exploring

Updates

No founder updates yet. Check back soon.