Ankit Gupta

injecting_numeracy. The accompanying code for "Injecting Numerical Reasoning Skills into Language Models" (Mor Geva*, Ankit Gupta* and Jonathan Berant, ACL 2020).

top_k_attention. The accompanying code for "Memory-efficient Transformers via Top-k Attention" (Ankit Gupta, Guy Dar, Shaya Goodman, David Ciprut, Jonathan Berant. SustaiNLP 2021).

dss. Sequence Modeling with Structured State Spaces

dlr. The accompanying code for "Simplifying and Understanding State Space Models with Diagonal Linear RNNs" (Ankit Gupta, Harsh Mehta, Jonathan Berant).

mel-asr. The accompanying code for "Exploring the limits of decoder-only models trained on public speech recognition corpora" (Ankit Gupta, George Saon, Brian Kingsbury. Interspeech 2024).

gmat. The accompanying code for the paper "GMAT: Global Memory Augmentation for Transformers" (Ankit Gupta and Jonathan Berant).

AI_Bot_for_playing_PacMan. A deep convolutional neural net (CNN) for playing the well-known arcade game ‘Ms. Pac-Man’ trained using Q-learning (reinforcement learning). Game data is obtained using the ‘OpenAI Gym’. The neural net significantly outperforms all tried uniform-random strategies. We do not inject any prior knowledge in the Q-nets. For instance, we do not explicitly use the distance from the ghosts - the system only has access to the game frames and has to learn everything by itself.

English_Vietnamese_Translator. A recurrent neural net (RNN) based Neural Machine Translator for translating English to Vietnamese built using an Encoder-Decoder model. Training was done using a small-scale parallel corpus of TED talks.

Sentiment_Analysis. A deep recurrent neural network (RNN) based classifier trained using the IMDb reviews dataset for detecting +ve/-ve sentiment in text. Text is encoded using trainable word embeddings and we get 90% test accuracy. Classifier can then be used to determine the sentiment score on Twitter data collected using the Twitter API.