Roee Aharoni

true. Code and data accompanying the paper "TRUE: Re-evaluating Factual Consistency Evaluation".

multilingual-t0. Multilingual extension of T0

q-squared. Python

t5x. Python

QuestEval. Python

ml-qrecc. Open-Domain Question Answering Goes Conversational via Question Rewriting

google-research. Google Research

joeynmt. Minimalist NMT for educational purposes

KoBE. Data and code for Knowledge-Based Machine Translation Evaluation (KoBE)

simalign. [EMNLP 2020] Obtain Word Alignments using Pretrained Language Models (e.g., mBERT)

yap. Yet Another (natural language) Parser

flair. A very simple framework for state-of-the-art Natural Language Processing (NLP)

xtreme. XTREME is a benchmark for the evaluation of the cross-lingual generalization ability of pre-trained multilingual models that covers 40 typologically diverse languages and includes nine tasks.

tokenizers. 💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

DA4NMT. NMT domain adaptation papers (updating...)

sentence-transformers. State-of-the-Art Embeddings, Retrieval, and Reranking

compare-mt. A tool for holistic analysis of language generations systems

dali. Domain Adaptation of Neural Machine Translation by Lexicon Induction

pyDPP. A python package for sampling from determinantal point processes

XLnet-gen. XLNet for generating language.

OpenNMT-APE. Python

lxmls-toolkit. Machine Learning applied to Natural Language Processing Toolkit used in the Lisbon Machine Learning Summer School

kenlm. KenLM: Faster and Smaller Language Model Queries

moore-lewis. Scripts to compute moore-lewis using kenlm

bert. TensorFlow code and pre-trained models for BERT

clip-as-service. 🏄 Scalable embedding, reasoning, ranking for images and sentences with CLIP

faiss. A library for efficient similarity search and clustering of dense vectors.

pysparnn. Approximate Nearest Neighbor Search for Sparse Data in Python!

transformers. 🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

sentencepiece. Unsupervised text tokenizer for Neural Network-based text generation.

multeval. Easy Bootstrap Resampling and Approximate Randomization for BLEU, METEOR, and TER using Multiple Optimizer Runs. This implements "Better Hypothesis Testing for Statistical Machine Translation: Controlling for Optimizer Instability" from ACL 2011.

segmenter. Universal segmenter based on the Universal Dependency framework, written by Y. Shao, Uppsala University

fast_align. Simple, fast unsupervised word aligner

gt-nlp-class. Course materials for Georgia Tech CS 4650 and 7650, "Natural Language"

translate. Translate - a PyTorch Language Library

fairseq. Facebook AI Research Sequence-to-Sequence Toolkit written in Python.

multilingual_nmt. Experiments on Multilingual NMT

rapid-adaptation. Reproduction instructions for "Rapid Adaptation of Neural Machine Translation to New Languages"

word-embeddings-for-nmt. Supplementary material for "When and Why Are Pre-trained Word Embeddings Useful for Neural Machine Translation?" at NAACL 2018

Seq2Seq-Vis. Visualization for Sequential Neural Networks with Attention

ConfidenceThroughAttention. Confidence Through Attention

sockeye. Sequence-to-sequence framework with a focus on Neural Machine Translation based on PyTorch

cmudict. CMU US English Dictionary

g2p-seq2seq. G2P with Tensorflow

marian-examples. Examples, tutorials and use cases for Marian, including our WMT-2017/18 baselines.

pronouncingpy. A simple interface for the CMU pronouncing dictionary

undreamt. Unsupervised Neural Machine Translation

dds-nmt. Dynamic data selection for neural machine translation

vecmap. A framework to learn cross-lingual word embedding mappings

Transformer-DyNet. An Implementation of Transformer (Attention Is All You Need) in DyNet

marian-dev. Fast Neural Machine Translation in C++ - development repository

spaCy. 💫 Industrial-strength Natural Language Processing (NLP) in Python

Split-and-Rephrase. The WebSplit Benchmark introducing "Split and Rephrase" task

tagger. Named Entity Recognition Tool

tree-viewer. A d3.js syntax tree viewer

sacrebleu. Reference BLEU implementation that auto-downloads test sets and reports a version string to facilitate cross-lab comparisons

seq2seq.pytorch. Sequence-to-Sequence learning using PyTorch

NLPH. The Vision and goals of the Open Natural Language Processing in Hebrew Project

talbaumel.github.io. HTML

Theano. Theano was a Python library that allows you to define, optimize, and evaluate mathematical expressions involving multi-dimensional arrays efficiently. It is being continued as PyTensor: www.github.com/pymc-devs/pytensor

bist-parser. Graph-based and Transition-based dependency parsers based on BiLSTMs

marian. Fast Neural Machine Translation in C++

xnmt. eXtensible Neural Machine Translation

seq2seq-baseline-dynet. C++

dynmt-py. Neural machine translation implementation using dynet's python bindings

OpenNMT-py. Open Source Neural Machine Translation and (Large) Language Models in PyTorch

MSVED-morph-reinflection. An implementation of semi-supervised VAE for morphology reinflection.

Zoph_RNN. C++/CUDA toolkit for training sequence and sequence-to-sequence models across multiple GPUs

jasonkessler.github.io. HTML

sigmorphon2016. C

keras. Deep Learning for humans

models. Models and examples built with TensorFlow

lectures. Oxford Deep NLP 2017 course

gdrive. Google Drive CLI Client

lingeval97. Python

bllip-parser. BLLIP reranking parser (also known as Charniak-Johnson parser, Charniak parser, Brown reranking parser) See http://pypi.python.org/pypi/bllipparser/ for Python module.

yap. Yet Another (natural language) Parser

dynet. DyNet: The Dynamic Neural Network Toolkit

nmt-list. A list of Neural MT implementations

wmt16-scripts. scripts and configuration files for Edinburgh neural MT submission to WMT 16 shared translation task

nematus. Open-Source Neural Machine Translation in Tensorflow

dynmt. Python

subword-nmt. Unsupervised Word Segmentation for Neural Machine Translation and Text Generation

lamtram. lamtram: A toolkit for neural language and translation modeling

nmt-tips. A tutorial about neural machine translation including tips on building practical systems

wikipedia-parallel-titles. Tools for extracting parallel corpora from article titles across languages in Wikipedia

mosesdecoder. Moses, the machine translation system