Konstantin Mishchenko

prodigy. The Prodigy optimizer and its variants for training neural networks.

opt_methods. Benchmarking optimization methods on convex problems.

random_reshuffling. RR, SO, IG and SGD with logistic regression loss.

asynchronous_sgd. Code used for paper on Asynchronous SGD published at NeurIPS 2022

global-newton. Jupyter Notebook

rr_prox_fed. Proximal and Federated Random Reshuffling

pytorch_optimizers. Stochastic optimizers in pytorch

Plume_labs. Jupyter Notebook

proxyprox. Python

examples. A set of examples around pytorch in Vision, Text, Reinforcement Learning, etc.

dave_rpg. Jupyter Notebook