Aran Komatsuzaki

Diff-DALLE. Python

Alpha-Transformer. Alpha Zero equipped with Transformer with various novel techniques for speedup in tree search

Metroplex. Python

adapinp. Unofficial implementation of Adaptive Input in PyTorch

txt2numpy. A series of scripts to convert a set of txt files into a set of numpy arrays

GPTNeo. An implementation of model parallel GPT2& GPT3-like models, with the ability to scale up to full GPT3 sizes (and possibly more!), using the mesh-tensorflow library.

score_sde. Official code for Score-Based Generative Modeling through Stochastic Differential Equations

transformers. 🤗Transformers: State-of-the-art Natural Language Processing for Pytorch and TensorFlow 2.0.

DALLE-mtf. Open-AI's DALL-E for large scale training in mesh-tensorflow.