Sasha Rush

GPU-Puzzles. Solve puzzles. Learn CUDA.

Tensor-Puzzles. Solve puzzles. Improve your pytorch.

MiniChain. A tiny library for coding with large language models.

awesome-o1. A bibliography and survey of the papers surrounding o1

LLM-Training-Puzzles. What would you do with 1000 H100s...

llama2.rs. A fast llama2 decoder in pure Rust.

annotated-s4. Implementation of https://srush.github.io/annotated-s4

Autodiff-Puzzles. Jupyter Notebook

annotated-mamba. Annotated version of the Mamba paper

Transformer-Puzzles. Puzzles for exploring transformers

streambook. Live Python Notebooks with any Editor

raspy. An interactive exploration of Transformer programming.

do-we-need-attention. TeX

parallax. Python

GPTWorld. A puzzle to learn about prompting

awesome-ml-tracking.

triton-autodiff. Experiment of using Tangent to autodiff triton

torch-queue. Python

LLM-Talk.

torch-golf. Silly twitter torch implementations.

mamba-primer.

PyDecode. A dynamic programming toolkit.

VirtualTeaching. DIY setup for virtual teaching on ubuntu

prof8. Experimental paper writing linter.

learns-dex.

text2table. Python

jax-lda. Python

ProbTalk. HTML

Tensor-Puzzles-Penzai. HTML

Hierarchical-Bayes-Compiler. Hal Daume's hbc

anynp. Proof-of-concept of global switching between numpy/jax/pytorch in a library.

torch-mechanics. Amateur experiments with autodiff mechanics simulators

PowerEdit. A super-minimal Python-based video editor ⚡

minitorch-rust.

cs5781. Machine Learning Engineering