Simo Ryu — Vaya

lora. Using Low-rank adaptation to quickly fine-tune diffusion models.

7.5k

minDiffusion. Self-contained, minimalistic implementation of diffusion models with Pytorch.

1.2k

paint-with-words-sd. Implementation of Paint-with-words with Stable Diffusion : method from eDiff-I that let you generate image from text-labeled segmentation map.

646

minRF. Minimal implementation of scalable rectified flow transformers, based on SD3's approach

638

minSDXL. Huggingface-compatible SDXL Unet implementation that is readily hackable

439

vqgan-training. Train VAE like a boss

313

d3pm. Minimal Implementation of a D3PM in pytorch

306

consistency_models. Unofficial Implementation of Consistency Models in pytorch

259

min-max-gpt. Minimal (400 LOC) implementation Maximum (multi-node, FSDP) GPT training

132

realformer-pytorch. Implementation of RealFormer using pytorch

101

magicmix. Unofficial Implementation of MagicMix

98

scaling-guide. WIP

96

min-fsdp. Python

93

ezmup. Simple implementation of muP, based on Spectral Condition for Feature Learning. The implementation is SGD only, dont use it for Adam

88

t2i-adapter-diffusers. Python

86

sdxl_inversions. Jupyter Notebook

85

promptplusplus. Jupyter Notebook

73

ptx-tutorial-by-aislop. PTX-Tutorial Written Purely By AIs (Deep Research of Openai and Claude 3.7)

66

sd-various-ideas. Jupyter Notebook

56

karras-power-ema-tutorial. Python

53

insightful-nn-papers. These papers will provide unique insightful concepts that will broaden your perspective on neural networks and deep learning

48

clipping-CLIP-to-GAN. Python

42

imagenet.int8. Python

40

zeroshampoo. Python

33

fim-llama-deepspeed. Python

32

repa-rf. Python

32

infinite-fractal-stream. Jupyter Notebook

30

minSAE. Python

30

auto_llm_codebase_analysis. Python

27

min-max-in-dit. Python

27

minVJEPA. Python

25

project_RF. Python

24

minDinoV2. Python

24

efae. Python

24

inversion_edits. Jupyter Notebook

21

planning-with-diffusion-tutorial. Jupyter Notebook

18

zeroshot-storytelling. Github repository for Zero Shot Visual Storytelling

15

blocked-decorr. Python

13

ptar. C++

13

poly2SOP. Transformer takes a polynomial, expresses it as sum of powers.

11

minMomentMatching. Python

11

smallest_working_performer. Python

10

minmoe. Python

6

n-body-dynamic-cuda. Cuda

6

smallest_working_gpt. gpt that is even smaller

6

rectified-flow. Jupyter Notebook

5

torchcu. Python

5

reverse_eng_deepspeed_study. DeepSpeed Study, focused on reverse engineering and enhancing documentation

5

imgdataset_process. Python

4

lora_dreambooth_replicate. Jupyter Notebook

4

SemanticSegmentationTrainerTemplate. Python

1

cv. Simple CV (pdf, Latex)

1

netfilter. C

1

unn-lstm-torch. Python

1

Super-Simple-LSTM-Template. Python

1

send-arp. C++

1

Freshman_2. Lecture notes from my Freshman 2nd semester

1