Emin Orhan

baby-vision. Self-supervised learning through the eyes of a child

mixture-of-experts. Mixture of experts layers for Keras

silicon-menagerie. Menagerie of models trained on SAYCam (and more)

recurrent-memory. When do neural networks learn sequential vs. persistent solutions in short-term memory tasks?

resnext-wsl. Robustness properties of Facebook's ResNeXt WSL models

humanlike-vits. ViT models pretrained with up to ~5k hours of human-like video data

ood-benchmarks. Out-of-distribution generalization benchmarks for image recognition models

inevitable-probability. Efficient probabilistic inference in generic neural networks trained with non-probabilistic feedback

robust-vision. Improving the robustness of ImageNet classifiers against natural and adversarial perturbations

llm-memory. Memory experiments with LLMs

video-models. Menagerie of video models trained on various video datasets

vqgan-gpt. GPT on VQGAN

hvm-1. Video models trained on ~5k hours of human-like video data

dino. DINO

gutenberg. Python

neural-pile-rodent. spiking neural activity data from rodents

nonnormal-init. Sequential non-normal initializers for recurrent neural networks

third-order. an experimental third-order attention model

transformer-metaseq2seq. Meta-seq2seq with generic transformers

igpt. Image GPT

parsing-transformers. Compositional generalization in semantic parsing with pretrained transformers

mae_st. Spatiotemporal Masked Autoencoders for video-based SSL

simsiam. A SimSiam implementation with a pure MLP encoder

simple-cache. A simple cache model for image recognition

frontier-accelerate. llm training workbook for frontier

neural-pile-rodent-old. spiking neural activity data from rodents

optimized-mae. An optimized implementation of masked autoencoders (MAEs)

neural-pile-primate-old. spiking neural activity data from primates

vqgan-gpt-video. GPT on VQGAN for video

bold-5000. fMRI signals from visual cortical areas are too noisy to distinguish between drastically different image recognition models

relational-recurrent. Attempted reproduction of the relational LSTM model.

neural-pile-primate. spiking neural activity data from primates