What Drives Paper Acceptance? A Process-Centric Analysis of Modern Peer Review

Inbum Heo, Goun Pyeon, Hyungjin Ahn, Sangkeun Jung


Abstract
Peer review is the primary mechanism for evaluating scientific contributions, yet prior studies have mostly examined paper features or external metadata in isolation. The emergence of open platforms such as OpenReview has transformed peer review into a transparent and interactive process, recording not only scores and comments but also rebuttals, reviewer–author exchanges, and meta-reviewer decisions. In this paper, we present a large-scale empirical study of ICLR 2017–2025, encompassing over 28,000 submissions, integrating four dimensions: paper structure and language quality, submission strategies and external metadata, author–reviewer interaction dynamics, and reviewer disagreement patterns. Our results show that factors beyond scientific novelty significantly shape acceptance outcomes. In particular, the rebuttal stage emerges as a decisive phase: timely, substantive author–reviewer communication strongly increases acceptance likelihood, often outweighing initial reviewer skepticism. Clearer writing, earlier submission, and effective disagreement resolution also correlate with higher acceptance probabilities. Based on these findings, we propose data-driven guidelines for authors, reviewers, and meta-reviewers to enhance transparency and fairness in peer review.
Anthology ID:
2026.emnlp-main.1123
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
25711–25731
Language:
URL:
https://aclanthology.org/2026.emnlp-main.1123/
DOI:
Bibkey:
Cite (ACL):
Inbum Heo, Goun Pyeon, Hyungjin Ahn, and Sangkeun Jung. 2026. What Drives Paper Acceptance? A Process-Centric Analysis of Modern Peer Review. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 25711–25731, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
What Drives Paper Acceptance? A Process-Centric Analysis of Modern Peer Review (Heo et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.1123.pdf