Ahmed Elnaggar

ProtTrans. ProtTrans is providing state of the art pretrained language models for proteins. ProtTrans was trained on thousands of GPUs from Summit and hundreds of Google TPUs using Transformers Models.

CodeTrans. Pretrained Language Models for Source code

Ankh. Ankh: Optimized Protein Language Model

google-innovator-tpu-lm.

nlp-tutorial. Natural Language Processing Tutorial for Deep Learning Researchers

Best-README-Template. An awesome README template to jumpstart your projects!

text-to-text-transfer-transformer. Code for the paper "Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer"

torchax-huggingface. Jupyter Notebook