pycolab. A highly-customisable gridworld game engine with some batteries included. Make your own gridworld games to test reinforcement learning agents!