Horovod

Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.