Keith

TransformerLens. A library for mechanistic interpretability of GPT-style language models

steering-vectors. Steering vectors for transformer language models in Pytorch / Huggingface

flash_attention_from_scratch. Flash Attention from Scratch on CUDA Ampere

TinyVision. A deep learning framework for vision task

TinyTorch. A lightweight deep learning training framework implemented from scratch in C++, featuring a PyTorch-style API.

3DGPT. Python

nanoGPT. The simplest, fastest repository for training/finetuning medium-sized GPTs.

ijepa. Official codebase for I-JEPA, the Image-based Joint-Embedding Predictive Architecture. First outlined in the CVPR paper, "Self-supervised learning from images with a joint-embedding predictive architecture."

gpu_performance_api. GPU Performance API for AMD GPUs

hardware-perfcounter. libraries and utilities for sampling hardware performance counters

LLGL. Low Level Graphics Library (LLGL) is a thin abstraction layer for the modern graphics APIs OpenGL, Direct3D, Vulkan, and Metal

GPU-my-list-of-bugs. Vulkan and other GPU API bugs I found.

vulkan-shadertoy-launcher. using C, no external dependencies

spvm. Tiny C++ SPIR-V virtual machine (interpreter), can be used for shader debugging. Spvm-ShaderToy simulated the runtime environment of shadertoy, and execute shader code using SPVM.

TLSHook. Hook opengl es function call on Android by replacing TLS entry point

RRFS. Python

GrayCode. Gray-Code Structured Light utilities

spine-opengl. Render Spine Animation Using OpenGL/OpenGL ES on Mac/Android/iOS

WAVM. WebAssembly Virtual Machine

depthy. Extract depth map and original from photos made with Google Camera's Lens Blur.

aerial_mapper. Real-time Dense Point Cloud, Digital Surface Map (DSM) and (Ortho-)Mosaic Generation for UAVs

colmap. COLMAP - Structure-from-Motion and Multi-View Stereo

soccerontable. Upconverting YouTube soccer videos in 3D for viewing in AR/VR devices.Soccer On Your Tabletop