Soumith Chintala

FACTO. Framework for Algorithmic Correctness Testing of Operators

opencode. A powerful AI coding agent. Built for the terminal.

helion. A Python-embedded DSL that makes it easy to write fast, scalable ML kernels with minimal boilerplate.

torchcodec. PyTorch media decoding and encoding

codemcp. Coding assistant MCP for Claude Desktop

ao. PyTorch native quantization and sparsity for training and inference

depyf. depyf is a tool to help you understand and adapt to PyTorch compiler torch.compile.

torchtitan. A PyTorch native platform for training generative AI models

torchtune. PyTorch native post-training library

llm.c. LLM training in simple, raw C/CUDA

speechbrain. A PyTorch-based Speech Toolkit

search_with_lepton. Building a quick conversation-based search demo with Lepton AI.

tensordict. TensorDict is a pytorch dedicated tensor container.

textgen. Open-source desktop app for local LLMs. Text, vision, tool-calling, OpenAI/Anthropic-compatible API. 100% private.

gpt-fast. Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.

open_flamingo. An open-source framework for training large multimodal models.

nanoGPT. The simplest, fastest repository for training/finetuning medium-sized GPTs.

pytorch. Tensors and Dynamic neural networks in Python with strong GPU acceleration

asdl. ASDL: Automatic Second-order Differentiation Library for PyTorch

AITemplate. AITemplate is a Python framework which renders neural network into high performance CUDA/HIP C++ code. Specialized for FP16 TensorCore (NVIDIA GPU) and MatrixCore (AMD GPU) inference.

multipy. torch::deploy (multipy for non-torch uses) is a system that lets you get around the GIL problem by running multiple Python interpreters in a single C++ process.

cog. Containers for machine learning

pytorch-jit-paritybench. Python

realtime_urdf_filter. ROS package that can filter geometry defined in URDF models from Kinect depth images. Can also preprocess data for the OpenNI tracker, to remove backgrounds, robots etc.

nice-slam. [CVPR'22] NICE-SLAM: Neural Implicit Scalable Encoding for SLAM

disco-diffusion. Jupyter Notebook

cleanlab. Cleanlab's open-source library is the standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.

xsimd. C++ wrappers for SIMD intrinsics and parallelized, optimized mathematical functions (SSE, AVX, AVX512, NEON, SVE, WebAssembly, VSX, RISC-V))

torch-queue. Python

Kimera-VIO. Visual Inertial Odometry with SLAM capabilities and 3D Mesh generation.

huginn. Create agents that monitor and act on your behalf. Your agents are standing by!

s4. Structured state space sequence models

cupoch. Robotics with GPU computing

nogil. Multithreaded Python without the GIL

ros-noetic. vinca configuration files for ros-noetic

pybind11_json. Using nlohmann::json with pybind11

uWebSockets. Simple, secure & standards compliant web server for the most demanding of applications

uSockets. Miniscule cross-platform eventing, networking & crypto for async applications

aiortc. WebRTC and ORTC implementation for Python using asyncio

benchmark. TorchBench is a collection of open source benchmarks used to evaluate PyTorch performance.

functorch. functorch is JAX-like composable function transforms for PyTorch.

CLIP. CLIP (Contrastive Language-Image Pretraining), Predict the most relevant text snippet given an image

PythonRobotics. Python sample codes and textbook for robotics algorithms.

MonitorControl. 🖥 Control your display's brightness & volume on your Mac as if it was a native Apple Display. Use Apple Keyboard keys or custom shortcuts. Shows the native macOS OSDs.

Rectangle. Move and resize windows on macOS with keyboard shortcuts and snap areas

fairscale. PyTorch extensions for high performance and large scale training.

minGPT. A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training

elastic. PyTorch elastic training

siren. PyTorch implementation of Sinusodial Representation networks (SIREN)

stable-baselines3. PyTorch version of Stable Baselines, reliable implementations of reinforcement learning algorithms.

parallax. Python

PyRetri. Open source deep learning based unsupervised image retrieval toolbox built on PyTorch🔥

PhiFlow. A differentiable PDE solving framework for machine learning

axcell. Tools for extracting tables and results from Machine Learning papers

drq. DrQ: Data regularized Q

jukebox. Code for the paper "Jukebox: A Generative Model for Music"

first-order-model. This repository contains the source code for the paper First Order Motion Model for Image Animation

pytorch_scatter. PyTorch Extension Library of Optimized Scatter Operations

releasing-research-code. Tips for releasing research code in Machine Learning (with official NeurIPS 2020 recommendations)

nerf-pytorch. A PyTorch implementation of NeRF (Neural Radiance Fields) that reproduces the results.

TensorRT. PyTorch/TorchScript/FX compiler for NVIDIA GPUs using TensorRT

pytorch-alpine. A very small PyTorch container in Alpine Linux

pytorch3d. PyTorch3D is FAIR's library of reusable components for deep learning with 3D data

pytorch-cpp. C++ Implementation of PyTorch Tutorials for Everyone

mmf. A modular framework for vision & language multimodal research from Facebook AI Research (FAIR)

SlowFast. PySlowFast: video understanding codebase from FAIR for reproducing state-of-the-art video models.

pytorch-metric-learning. The easiest way to use deep metric learning in your application. Modular, flexible, and extensible. Written in PyTorch.

indic-trans. The project aims on adding a state-of-the-art transliteration module for cross transliterations among all Indian languages including English.

java-demo. PyTorch Java demo

SoftRas. Project page of paper "Soft Rasterizer: A Differentiable Renderer for Image-based 3D Reasoning"

cvxpylayers. Differentiable convex optimization layers

HParams. Configure Python functions explicitly and safely

anaconda-issues. Anaconda issue tracking

detectron2. Detectron2 is a platform for object detection, segmentation and other visual recognition tasks.

higher. higher is a pytorch library allowing users to obtain higher order gradients over losses spanning training loops rather than individual training steps.

cortex. Production infrastructure for machine learning at scale

espresso. Espresso: A Fast End-to-End Neural Speech Recognition Toolkit

learn2learn. A PyTorch Library for Meta-learning Research

LegoNet. A Pytorch implementation of "LegoNet: Efficient Convolutional Neural Networks with Lego Filters" (ICML 2019).

pix2pixHD. Synthesizing and manipulating 2048x1024 images with conditional GANs

pytorch-struct. Fast, general, and tested differentiable structured prediction in PyTorch

facenet-pytorch. Pretrained Pytorch face detection (MTCNN) and facial recognition (InceptionResnet) models

pywarm. A cleaner way to build neural networks for PyTorch.

Megatron-LM. Ongoing research training transformer models at scale

jetson-inference. Hello AI World guide to deploying deep-learning inference networks and deep vision primitives with TensorRT and NVIDIA Jetson.

wavetorch. 🌊 Numerically solving and backpropagating through the wave equation

pytorch-sift. PyTorch implementation of SIFT descriptor

brevitas. Brevitas: neural network quantization in PyTorch

NCRF. Cancer metastasis detection with neural conditional random field (NCRF)

d2l-pytorch. This project reproduces the book Dive Into Deep Learning (https://d2l.ai/), adapting the code from MXNet into PyTorch.

DG-Net. :couple: Joint Discriminative and Generative Learning for Person Re-identification. CVPR'19 (Oral) :couple:

fasterzip. A faster python zipfile.

thinking-in-tensors-writing-in-pytorch. Thinking in tensors, writing in PyTorch (a hands-on deep learning intro)

torchprof. PyTorch layer-by-layer model profiler

osqpth. The differentiable OSQP solver layer for PyTorch

diffdist. Python

mctorch. A manifold optimization library for deep learning

xlnet-Pytorch. Simple XLNet implementation with Pytorch Wrapper

naacl_transfer_learning_tutorial. Repository of code for the tutorial on Transfer Learning in NLP held at NAACL 2019 in Minneapolis, MN, USA

accimage. high performance image loading and augmenting routines mimicking PIL.Image interface

pyrobot. PyRobot: An Open Source Robotics Research Platform

glow-pytorch. PyTorch implementation of Glow

STEAL. STEAL - Learning Semantic Boundaries from Noisy Annotations (CVPR 2019)

texar-pytorch. Integrating the Best of TF into PyTorch, for Machine Learning, Natural Language Processing, and Text Generation. This is part of the CASL project: http://casl-project.ai/

brain-segmentation-pytorch. U-Net implementation in PyTorch for FLAIR abnormality segmentation in brain MRI

hub. Submission to https://pytorch.org/hub/

pytorch-kaldi. pytorch-kaldi is a project for developing state-of-the-art DNN/RNN hybrid speech recognition systems. The DNN part is managed by pytorch, while feature extraction, label computation, and decoding are performed with the kaldi toolkit.

EfficientNets-PyTorch. A PyTorch implementation of " EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks."

pytorch-hessian-eigenthings. Efficient PyTorch Hessian eigendecomposition tools!

tensorwatch. Debugging, monitoring and visualization for Python Machine Learning and Data Science

torchgpipe. A GPipe implementation in PyTorch

colabtools. Python libraries for Google Colaboratory

extension-cpp. C++ extensions in PyTorch

transfer-nlp. NLP library designed for reproducible experimentation management

EigenDamage-Pytorch. Code for "EigenDamage: Structured Pruning in the Kronecker-Factored Eigenbasis" https://arxiv.org/abs/1905.05934

pytorch-image-models. The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (ViT), MobileNetV4, MobileNet-V3 & V2, RegNet, DPN, CSPNet, Swin Transformer, MaxViT, CoAtNet, ConvNeXt, and more

MeshCNN. Convolutional Neural Network for 3D meshes in PyTorch

MinkowskiEngine. Minkowski Engine is an auto-diff neural network library for high-dimensional sparse tensors

self-driving-desktop. Desktop Automation Framework. Drive your mouse and keyboard with an easy to use language.

transformer-xl. Training Transformer-XL on 128 GPUs

Ax. Adaptive Experimentation Platform

botorch. Bayesian optimization in PyTorch

MixHop-and-N-GCN. An implementation of "MixHop: Higher-Order Graph Convolutional Architectures via Sparsified Neighborhood Mixing" (ICML 2019).

Genomic-ULMFiT. ULMFiT for Genomic Sequence Data

XLM. PyTorch original implementation of Cross-lingual Language Model Pretraining.

ig. :fireworks: Include graph visualization for C++

flowpoints_ml. An intuitive approach to creating deep learning models

pytorch-sync-batchnorm-example. How to use Cross Replica / Synchronized Batchnorm in Pytorch

pytorch-toolbelt. PyTorch extensions for fast R&D prototyping and Kaggle farming

TorchSharp. .NET bindings for the Pytorch engine

spacy-course. 👩‍🏫 Advanced NLP with spaCy: A free online course

triton. Development repository for the Triton language and compiler

pytorch-cpp-rl. PyTorch C++ Reinforcement Learning

tensor-stream. A library for real-time video stream decoding to CUDA memory

macarico. learning to search in pytorch

lotranslate. LibreOffice Neural Machine Translation

DGC-Net. A PyTorch implementation of "DGC-Net: Dense Geometric Correspondence Network"

breast_cancer_classifier. Deep Neural Networks Improve Radiologists' Performance in Breast Cancer Screening

mathematics_dataset. This dataset code generates mathematical question and answer pairs, from a range of question types at roughly school-level difficulty.

PyTorch-BigGraph. Generate embeddings from large-scale graph-structured data.

densebody_pytorch. PyTorch implementation of CloudWalk's recent work DenseBody

pytorch-lightning. Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.

ParlAI. A framework for training and evaluating AI models on a variety of openly available dialogue datasets.

inltk. Natural Language Toolkit for Indic Languages aims to provide out of the box support for various NLP tasks that an application developer might need

CapsGNN. A PyTorch implementation of "Capsule Graph Neural Network" (ICLR 2019).

ghstack. Submit stacked diffs to GitHub on the command line

Tor10. A Generic Tensor-Network library that is designed for quantum simulation, base on the pytorch

voicefilter. Unofficial PyTorch implementation of Google AI's VoiceFilter system

BigGAN-PyTorch. The author's officially unofficial PyTorch BigGAN implementation.

ppo_libtorch. C++ implementation of Proximal Policy Optimization

pytorch-OpCounter. Count the MACs / FLOPs of your PyTorch model.

imagenette. A smaller subset of 10 easily classified classes from Imagenet, and a little more French

tch-rs. Rust bindings for the C++ api of PyTorch.

AdaBound. An optimizer that trains as fast as Adam and as good as SGD.

gpt-2-Pytorch. Simple Text-Generator with OpenAI gpt-2 Pytorch Implementation

circle. The compiler is available for download. Get it!

benchmarking-keras-pytorch. 🔥 Reproducibly benchmarking Keras and PyTorch models

AudioMNIST. Python

box-convolutions. PyTorch code for the "Deep Neural Networks with Box Convolutions" paper

neural-pipeline. Neural networks training pipeline based on PyTorch

Person_reID_baseline_pytorch. :bouncing_ball_person: Pytorch ReID: A tiny, friendly, strong pytorch implement of person re-id / vehicle re-id baseline. Tutorial 👉https://github.com/layumi/Person_reID_baseline_pytorch/tree/master/tutorial

kornia. 🐍 Geometric Computer Vision Library for Spatial AI

pytorch-prunes. Code for https://arxiv.org/abs/1810.04622

geoopt. Riemannian Adaptive Optimization Methods with pytorch optim

pytorch-checkpoint. Python

delira. Lightweight framework for fast prototyping and training deep neural networks with PyTorch and TensorFlow

Shufflenet-v2-Pytorch. Perfect implement. Model shared. x0.5 (Top1:60.646) and 1.0x (Top1:69.402).

pytorch-mobilenet-v2. A PyTorch implementation of MobileNet V2 architecture and pretrained model.

FaceBoxes.PyTorch. A PyTorch Implementation of FaceBoxes

transformer-xl. Python

associative_compression_networks. Python

pytorch-inference. PyTorch 1.0 inference in C++ on Windows10 platforms

pytorch-cpp-inference. Serving PyTorch 1.0 Models as a Web Server in C++

fluidnet_cxx. FluidNet re-written with ATen tensor lib

shap. A game theoretic approach to explain the output of any machine learning model.

flair. A very simple framework for state-of-the-art Natural Language Processing (NLP)

netharn. Parameterized fit and prediction harnesses for pytorch

nevergrad. A Python toolbox for performing gradient-free optimization

AICamera. Demonstration of using Caffe2 inside an Android application.

pytext. A natural language modeling framework based on PyTorch

dgl. Python package built to ease deep learning on graph, on top of existing DL frameworks.

Made-With-ML. Learn how to develop, deploy and iterate on production-grade ML applications.

jax. Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more

ocaml-torch. OCaml bindings for PyTorch

loss-landscape. Code for visualizing the loss landscape of neural nets

xla. Enabling PyTorch on XLA Devices (e.g. Google TPU)

CGNet. Python

AICamera_new. Recompile the library with caffe2 in pytorch stable(1.0) and re-implement the AICamera example provided by caffe2 officially.

PySyft. Perform data science on data that remains in someone else's server

catalyst. Accelerated deep learning R&D

famos. Adversarial Framework for (non-) Parametric Image Stylisation Mosaics

back2future.pytorch. Unsupervised Learning of Multi-Frame Optical Flow with Occlusions

einops. Flexible and powerful tensor operations for readable and reliable code (for pytorch, jax, TF and others)

onnxjs. ONNX.js: run ONNX models using JavaScript

miniz. miniz: Single C source file zlib-replacement library, originally from code.google.com/p/miniz

gandissect. Pytorch-based tools for visualizing and understanding the neurons of a GAN. https://gandissect.csail.mit.edu/

FFTNet. FFTNet vocoder implementation

medicaltorch. A medical imaging framework for Pytorch

3DDFA. The PyTorch improved version of TPAMI 2017 paper: Face Alignment in Full Pose Range: A 3D Total Solution.

euclidesdb. A multi-model machine learning feature embedding database