pytorch-model-profiler. A simple profiler for PyTorch models that can profile: FLOPs for the forward pass, FLOPs for the backward pass and peak memory consumption.