Csordás Róbert

MobilECG-II. Open source ECG holter

RFCN-tensorflow. RFCN implementation in TensorFlow

OnyxNoteRenderer. Tool for rendering note PDFs from Onyx Note backup file.

moe_attention. Official repository for the paper "SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention"

moeut. Python

transformer_generalization. The official repository for our paper "The Devil is in the Detail: Simple Tricks Improve Systematic Generalization of Transformers". We significantly improve the systematic generalization of transformer models on a variety of datasets using simple tricks and careful considerations.

linux-intel-undervolt-tool. Scripts for undervolting 6+th gen Intel i* CPUs and their internal GPU.

modules. The official repository for our paper "Are Neural Nets Modular? Inspecting Functional Modularity Through Differentiable Weight Masks". We develop a method for analyzing emerging functional modularity in neural networks based on differentiable weight masks and use it to point out important issues in current-day neural networks.

arch-efiboot. Boot EFISTUB linux kernels on UEFI systems not supporting kernel command line

moe. Official repository for the paper "Approximating Two-Layer Feedforward Networks for Efficient Transformers"

ndr. The official repository for our paper "The Neural Data Router: Adaptive Control Flow in Transformers Improves Systematic Generalization".

llm_effective_depth. Official codebase for our paper "Do Language Models Use Their Depth Efficiently?"

dnc. Experiments on Differentiable Neural Computer

moe_layer. sigma-MoE layer

switchhead. Python

linear_layer_as_attention. The official repository for our paper "The Dual Form of Neural Networks Revisited: Connecting Test Time Predictions to Training Patterns via Spotlights of Attention".

silent-xps. Turns off Dell XPS 15 fan when temperatures are low enough.

onion_representations. Python

molecule_gen. Implementation of "Learning Deep Generative Models"

moeut_training_code. Python

cluster_tool. Python

ctlpp. Codebase for our EMNLP 2022 paper "CTL++: Evaluating Generalization on Never-Seen Compositional Patterns of Known Functions, and Compatibility of Neural Representations"

OpenHaldex. C++

Oneplus3TrustZoneVersionCheck. Prints TrustZone version of fimware image without flashing.

linux_gpu_switch. Easy to use script to turn Nvidia GPU on/off on Linux.

gaussian_process_test. Jupyter Notebook

KaggleFish. Simple classifier for Kaggle fish classification challenge.

dqn. Simple DQN implementation in pytorch