Rare find

swarm-jax. Swarm training framework using Haiku + JAX + Ray for layer parallel transformer language models on unreliable, heterogeneous nodes

github.com/kingoflolz/swarm-jax
by @kingoflolz

Problem

Audience

Keep exploring

Updates

No founder updates yet. Check back soon.