This is your work, valued

Enrico Shippole

Elite
@conceptofmind

Odin sacrificed his eye to acquire knowledge but I would give far more.

www.teraflopai.com/

PaLM. An open-source implementation of Google's PaLM models

819

LaMDA-rlhf-pytorch. Open-source pre-training implementation of Google's LaMDA in PyTorch. Adding RLHF similar to ChatGPT.

466

toolformer. Python

384

t5-pytorch. Implementation of Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer in PyTorch.

53

vit-flax. Implementation of numerous Vision Transformers in Google's JAX and Flax.

22

PaLM-flax. Implementation of the SOTA Transformer architecture from PaLM - Scaling Language Modeling with Pathways in JAX/Flax

13

ViT-Patch-Merger. Python

7

Simple-ViT-flax. Python

5

hf_fsdp. A very basic fsdp wrapper for HF.

5

Adaptive-Token-Sampling-Flax. Python

4

CaiT-Flax. Python

3

mpire. A Python package for easy multiprocessing, but faster than multiprocessing

3

BloomCoder. Python

3

Twins-SVT-Flax. An open-source implementation of the Twins: Revisiting the Design of Spatial Attention in Vision Transformers research paper in Google's JAX and Flax.

2

ViT-Small-Datasets-flax. Python

2

PaLM-rlhf-pytorch. Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM

2

awesome-self-driving-car. An awesome list of self-driving cars

2

Long-context-transformers. Exploring finetuning public checkpoints on filter 8K sequences on Pile

2

FlexGen. Running large language models like ChatGPT/GPT-3/OPT-175B on a single GPU. Up to 100x faster than other offloading systems.

2

HojiChar. The robust text processing pipeline framework enabling customizable, efficient, and metric-logged text preprocessing.

1

magic-wormhole. get things from one computer to another, safely

1

unsloth-bert. Python

1

RL4LMs. A modular RL library to fine-tune language models to human preferences

1

GPTQ-for-LLaMa. 4 bits quantization of LLaMa using GPTQ

1

imagen-pytorch. Implementation of Imagen, Google's Text-to-Image Neural Network, in Pytorch

1

fastText. Library for fast text representation and classification.

1

ViT-haiku. Python

1

edgar-crawler. Download financial reports from SEC's EDGAR quickly. Extract clean textual data from specific item sections and bootstrap your financial research. Software from the research paper published in ECONLP 2021.

1

ViT. Python

1

Token-to-Token-ViT-flax. Python

1

deep-reinforcement-learning-go. Creation and implementation of an Alpha Go engine from scratch

1

Crossformer-flax. Python

1

DeepViT-flax. Implementation of Deep Vision Transformer in Flax

1

job-posting-analysis. Data Science job posting analysis and resume comparison using NLP and Scikit Learn

1

Everything-Machine-Learning.

1

pynecone. 🕸 Web apps in pure Python 🐍

1

PaLM-jax. Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways - in Jax (Equinox framework)

1

annotated-transformer. Python

1

ManimML. ManimML is a project focused on providing animations and visualizations of common machine learning concepts with the Manim Community Library.

1

LeViT-flax. Python

1

conceptofmind. Config files for my GitHub profile.

1

nanoChatGPT. A crude RLHF layer on top of nanoGPT with Gumbel-Softmax trick

1

scaled-rope. Python

1

OPTCode. Python

1

autofaiss. Automatically create Faiss knn indices with the most optimal similarity search parameters.

1