LM Transparency Tool: Interactive Tool for Analyzing Transformer Language Models

Information Flow Routes: Automatically Interpreting Language Models at Scale

Neurons in Large Language Models: Dead, N-gram, Positional

HalOmi: A Manually Annotated Benchmark for Multilingual Hallucination and Omission Detection in Machine Translation

Detecting and Mitigating Hallucinations in Machine Translation: Model Internal Workings Alone Do Well, Sentence Similarity Even Better

Looking for a Needle in a Haystack: A Comprehensive Study of Hallucinations in Neural Machine Translation

Language Modeling, Lexical Translation, Reordering: The Training Process of NMT through the Lens of Classical SMT

Analyzing the Source and Target Contributions to Predictions in Neural Machine Translation

Embedding Words in Non-Vector Space with Unsupervised Graph Learning

Information-Theoretic Probing with Minimum Description Length

BPE-Dropout: Simple and Effective Subword Regularization

Sequence Modeling with Unconstrained Generation Order

The Bottom-up Evolution of Representations in the Transformer: A Study with Machine Translation and Language Modeling Objectives

Context-Aware Monolingual Repair for Neural Machine Translation

Analyzing Multi-Head Self-Attention: Specialized Heads Do the Heavy Lifting, the Rest Can Be Pruned

When a Good Translation is Wrong in Context: Context-Aware Machine Translation Improves on Deixis, Ellipsis, and Lexical Cohesion

Context-Aware Neural Machine Translation Learns Anaphora Resolution

A Large-Scale Test Set for the Evaluation of Context-Aware Pronoun Translation in Neural Machine Translation