Nicklas Hansen

tdmpc2. Code for "TD-MPC2: Scalable, Robust World Models for Continuous Control"

tdmpc. Code for "Temporal Difference Learning for Model Predictive Control"

dreamer4. Unofficial implementation of the Dreamer 4 world model in PyTorch.

rnn_lstm_from_scratch. How to build RNNs and LSTMs from scratch with NumPy.

puppeteer. Code for "Hierarchical World Models as Visual Whole-Body Humanoid Controllers"

voice-activity-detection. Voice Activity Detection (VAD) using deep learning.

dmcontrol-generalization-benchmark. DMControl Generalization Benchmark

newt. Official code repository for the paper "Learning Massively Multitask World Models for Continuous Control".

policy-adaptation-during-deployment. Training code and evaluation benchmarks for the "Self-Supervised Policy Adaptation during Deployment" paper.

mmbench2. Official code repository for the paper "Hallucination in World Models is Predictable and Preventable".

neural-net-optimization. PyTorch implementations of recent optimization algorithms for deep learning.

minimal-nas. Minimal implementation of a Neural Architecture Search system.

svea-vit. Code for the paper "Stabilizing Deep Q-Learning with ConvNets and Vision Transformers under Data Augmentation"

nicklashansen.github.io. Repository for my personal site https://nicklashansen.github.io/, built with plain html.

adaptive-learning-rate-schedule. PyTorch implementation of the "Learning an Adaptive Learning Rate Schedule" paper found here: https://arxiv.org/abs/1909.09712.

a3c. Asynchronous Advantage Actor-Critic using Generalized Advantage Estimation (PyTorch)

docker-from-conda. Builds a docker image from a conda environment.yml file.

smallrl. Personal repository for quick RL prototyping. Work in progress!

nautilus-launcher. Minimal launcher for Nautilus

reinforcement-learning-sutton-barto. Personal repository for course on reinforcement learning. Includes implementations of various problems from the Reinforcement Learning: An Introduction book by R. Sutton and A. Barto.

metaworld. Fork of https://github.com/Farama-Foundation/Metaworld

awesome-rl-envs.

bachelor-thesis. Repository for bachelor thesis on Automatic Multi-Modal Detection of Autonomic Arousals in Sleep. The thesis itself and all related data is confidential and thus not publicly available, but access to the thesis can be granted by sending a request to hello@nicklashansen.com.

music-genre-classification. Exam project on Audio Features for Music Genre Classification for course 02452 Audio Information Processing Systems at Technical University of Denmark (DTU).