More Computational Resources Do Not Ensure Higher Scholarly Impact: Evidence from Leading NLP Conference Papers

Shuai Chen, Tong Bao, Jitong Peng, Chengzhi Zhang


Abstract
Computational resources are increasingly central to NLP research, but how closely reported GPU capability aligns with scholarly impact remains unclear. We analyze 13,921 ACL, EMNLP, and NAACL main-conference papers published between 2020 and 2025, using GPU resources as our operational measure of computational resources. From full texts, we extract GPU models and counts, standardize each paper’s largest reported configuration into a comparable hardware-capability measure, and link these data to citation, award, topic, and institutional metadata. GPU reporting became more common but remained incomplete, while reported capability increased mainly through newer hardware generations and medium-scale multi-GPU configurations. Resource concentration substantially exceeded impact concentration: the annual top 20% of GPU-quantifiable papers accounted for 83.9%–89.9% of reported GPU capability, but only 27%–32% of citations and 20%–33% of paper awards. In adjusted models, a tenfold increase in aggregate reported GPU capability was associated with a 3.52-percentage-point increase in within-NLP topic–year citation percentile, but increased model R2 by only 0.0042. GPU count showed more consistent positive associations with citation and award outcomes than newer hardware generation. Overall, reported GPU resources are associated with scholarly impact but provide little standalone explanation of research influence.
Anthology ID:
2026.emnlp-main.363
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
8307–8338
Language:
URL:
https://aclanthology.org/2026.emnlp-main.363/
DOI:
Bibkey:
Cite (ACL):
Shuai Chen, Tong Bao, Jitong Peng, and Chengzhi Zhang. 2026. More Computational Resources Do Not Ensure Higher Scholarly Impact: Evidence from Leading NLP Conference Papers. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 8307–8338, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
More Computational Resources Do Not Ensure Higher Scholarly Impact: Evidence from Leading NLP Conference Papers (Chen et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.363.pdf