OOIR: Observatory of International Research

Papers

(The TQCC of Transactions of the Association for Computational Linguistics is 11. The table below lists those papers that are above that threshold based on CrossRef citation counts [max. 250 papers]. The publications cover those that have been published in the past four years, i.e., from 2020-11-01 to 2024-11-01.)

Article	Citations
SpanBERT: Improving Pre-training by Representing and Predicting Spans	641
A Primer in BERTology: What We Know About How BERT Works	441
Multilingual Denoising Pre-training for Neural Machine Translation	348
Topic Modeling in Embedding Spaces	326
How Can We Know What Language Models Know?	313
KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representation	212
Efficient Content-Based Sparse Attention with Routing Transformers	169
Leveraging Pre-trained Checkpoints for Sequence Generation Tasks	131
What BERT Is Not: Lessons from a New Suite of Psycholinguistic Diagnostics for Language Models	126
SummEval: Re-evaluating Summarization Evaluation	112
Sparse, Dense, and Attentional Representations for Text Retrieval	108
A Survey on Automated Fact-Checking	97
TyDi QA: A Benchmark for Information-Seeking Question Answering in Typologically Diverse Languages	88
A Knowledge-Enhanced Pretraining Model for Commonsense Story Generation	81
Nested Named Entity Recognition via Second-best Sequence Learning and Decoding	61
Compressing Large-Scale Transformer-Based Models: A Case Study on BERT	61
ByT5: Towards a Token-Free Future with Pre-trained Byte-to-Byte Models	59
Samanantar: The Largest Publicly Available Parallel Corpora Collection for 11 Indic Languages	51
Dealing with Disagreements: Looking Beyond the Majority Vote in Subjective Annotations	50
Causal Inference in Natural Language Processing: Estimation, Prediction, Interpretation and Beyond	49
BLiMP: The Benchmark of Linguistic Minimal Pairs for English	47
oLMpics-On What Language Model Pre-training Captures	46
Lost in the Middle: How Language Models Use Long Contexts	42
Measuring and Improving Consistency in Pretrained Language Models	42
Self-Diagnosis and Self-Debiasing: A Proposal for Reducing Corpus-Based Bias in NLP	42

Machine Learning–Driven Language Assessment	41
Experts, Errors, and Context: A Large-Scale Study of Human Evaluation for Machine Translation	41
Multimodal Pretraining Unmasked: A Meta-Analysis and a Unified Framework of Vision-and-Language BERTs	40
Decoupling the Role of Data, Attention, and Losses in Multimodal Transformers	39
How Can We Know When Language Models Know? On the Calibration of Language Models for Question Answering	38
SummaC: Re-Visiting NLI-based Models for Inconsistency Detection in Summarization	37
The Flores-101 Evaluation Benchmark for Low-Resource and Multilingual Machine Translation	36
Gender Bias in Machine Translation	35
Benchmarking Large Language Models for News Summarization	32
Amnesic Probing: Behavioral Explanation with Amnesic Counterfactuals	32
Quality at a Glance: An Audit of Web-Crawled Multilingual Datasets	32
Theoretical Limitations of Self-Attention in Neural Sequence Models	32
CrossWOZ: A Large-Scale Chinese Cross-Domain Task-Oriented Dialogue Dataset	32
Investigating Prior Knowledge for Challenging Chinese Machine Reading Comprehension	32
An Empirical Survey of Data Augmentation for Limited Data Learning in NLP	31
In-Context Retrieval-Augmented Language Models	31
PAQ: 65 Million Probably-Asked Questions and What You Can Do With Them	30
MKQA: A Linguistically Diverse Benchmark for Multilingual Open Domain Question Answering	30
Membership Inference Attacks on Sequence-to-Sequence Models: Is My Data In Your Machine Translation System?	29
Did Aristotle Use a Laptop?A Question Answering Benchmark with Implicit Reasoning Strategies	29
Break It Down: A Question Understanding Benchmark	28
Improving the Domain Adaptation of Retrieval Augmented Generation (RAG) Models for Open Domain Question Answering	28
Soloist: BuildingTask Bots at Scale with Transfer Learning and Machine Teaching	28
Canine: Pre-training an Efficient Tokenization-Free Encoder for Language Representation	27
An Empirical Study on Robustness to Spurious Correlations using Pre-trained Language Models	27
Extractive Opinion Summarization in Quantized Transformer Spaces	26
Relevance-guided Supervision for OpenQA with ColBERT	26
Syntax-Guided Controlled Generation of Paraphrases	25
AMR-To-Text Generation with Graph Transformer	24
Modeling Global and Local Node Contexts for Text Generation from Knowledge Graphs	24
Time-Aware Language Models as Temporal Knowledge Bases	23
Beat the AI: Investigating Adversarial Human Annotation for Reading Comprehension	23
Data-to-text Generation with Macro Planning	23
Speak, Read and Prompt: High-Fidelity Text-to-Speech with Minimal Supervision	22
MasakhaNER: Named Entity Recognition for African Languages	22
Quantifying Social Biases in NLP: A Generalization and Empirical Comparison of Extrinsic Fairness Metrics	22
Why Does Surprisal From Larger Transformer-Based Language Models Provide a Poorer Fit to Human Reading Times?	21
PADA: Example-based Prompt Learning for on-the-fly Adaptation to Unseen Domains	21
A Survey on Cross-Lingual Summarization	21
Does Syntax Need to Grow on Trees? Sources of Hierarchical Inductive Bias in Sequence-to-Sequence Networks	20
Planning with Learned Entity Prompts for Abstractive Summarization	19
Efficient Methods for Natural Language Processing: A Survey	19
TopiOCQA: Open-domain Conversational Question Answering with Topic Switching	19
Explanation-Based Human Debugging of NLP Models: A Survey	19
Retrieve Fast, Rerank Smart: Cooperative and Joint Approaches for Improved Cross-Modal Retrieval	19
Best-First Beam Search	19
Multilingual Autoregressive Entity Linking	17
Data Weighted Training Strategies for Grammatical Error Correction	17
Acoustic-Prosodic and Lexical Cues to Deception and Trust: Deciphering How People Detect Lies	16
Unsupervised Quality Estimation for Neural Machine Translation	16

FeTaQA: Free-form Table Question Answering	16
Aligning Faithful Interpretations with their Social Attribution	16
Visual Spatial Reasoning	15
Context-aware Adversarial Training for Name Regularity Bias in Named Entity Recognition	15
Target-Guided Structured Attention Network for Target-Dependent Sentiment Analysis	15
Transformers for Tabular Data Representation: A Survey of Models and Applications	15
EDITOR: An Edit-Based Transformer with Repositioning for Neural Machine Translation with Soft Lexical Constraints	15
Sentence Similarity Based on Contexts	14
PERL: Pivot-based Domain Adaptation for Pre-trained Deep Contextualized Embedding Models	14
VILA: Improving Structured Content Extraction from Scientific PDFs Using Visual Layout Groups	14
Hallucinations in Large Multilingual Translation Models	14
Pre-train, Prompt, and Recommendation: A Comprehensive Survey of Language Modeling Paradigm Adaptations in Recommender Systems	13
Nurse is Closer to Woman than Surgeon? Mitigating Gender-Biased Proximities in Word Embeddings	13
ABNIRML: Analyzing the Behavior of Neural IR Models	13
Generative Spoken Dialogue Language Modeling	13
A Graph-based Model for Joint Chinese Word Segmentation and Dependency Parsing	12
Task-Oriented Dialogue as Dataflow Synthesis	12
Locally Typical Sampling	12
Reducing Conversational Agents’ Overconfidence Through Linguistic Calibration	12
QED: A Framework and Dataset for Explanations in Question Answering	12
Sketch-Driven Regular Expression Generation from Natural Language and Examples	12
Infusing Finetuning with Semantic Dependencies	11
Towards Question-Answering as an Automatic Metric for Evaluating the Content Quality of a Summary	11
Better Document-Level Machine Translation with Bayes’ Rule	11
Adaptive Semiparametric Language Models	11
How Much Do Language Models Copy From Their Training Data? Evaluating Linguistic Novelty in Text Generation Using RAVEN	11