transformer_lexical_shortcuts. Codebase accompanying the paper 'Widening the Representation Bottleneck in Neural Machine Translation with Lexical Shortcuts', (Emelin, Denis, Ivan Titov, and Rico Sennrich, Fourth Conference on Machine Translation, Florence, 2019.)