OOIR: Observatory of International Research

Papers

(The H4-Index of Transactions of the Association for Computational Linguistics is 27. The table below lists those papers that are above that threshold based on CrossRef citation counts [max. 250 papers]. The publications cover those that have been published in the past four years, i.e., from 2020-03-01 to 2024-03-01.)

Article	Citations
SpanBERT: Improving Pre-training by Representing and Predicting Spans	535
A Primer in BERTology: What We Know About How BERT Works	345
Multilingual Denoising Pre-training for Neural Machine Translation	264
Topic Modeling in Embedding Spaces	241
How Can We Know What Language Models Know?	207
KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representation	152
Efficient Content-Based Sparse Attention with Routing Transformers	130
Leveraging Pre-trained Checkpoints for Sequence Generation Tasks	111
What BERT Is Not: Lessons from a New Suite of Psycholinguistic Diagnostics for Language Models	108
Sparse, Dense, and Attentional Representations for Text Retrieval	86
SummEval: Re-evaluating Summarization Evaluation	69
TyDi QA: A Benchmark for Information-Seeking Question Answering in Typologically Diverse Languages	69
A Knowledge-Enhanced Pretraining Model for Commonsense Story Generation	65
A Survey on Automated Fact-Checking	54
Nested Named Entity Recognition via Second-best Sequence Learning and Decoding	47
Compressing Large-Scale Transformer-Based Models: A Case Study on BERT	45
ByT5: Towards a Token-Free Future with Pre-trained Byte-to-Byte Models	42
Samanantar: The Largest Publicly Available Parallel Corpora Collection for 11 Indic Languages	35
oLMpics-On What Language Model Pre-training Captures	34
Multimodal Pretraining Unmasked: A Meta-Analysis and a Unified Framework of Vision-and-Language BERTs	33
Gender Bias in Machine Translation	30
Machine Learning–Driven Language Assessment	30
Decoupling the Role of Data, Attention, and Losses in Multimodal Transformers	30
Dealing with Disagreements: Looking Beyond the Majority Vote in Subjective Annotations	30
Causal Inference in Natural Language Processing: Estimation, Prediction, Interpretation and Beyond	29

Experts, Errors, and Context: A Large-Scale Study of Human Evaluation for Machine Translation	28
Investigating Prior Knowledge for Challenging Chinese Machine Reading Comprehension	28