Citing Less Critically: LLMs Reshape the Rhetoric and Reach of Scientific Citation

Yixuan Liu, Lin Chen, Zhuoqi Liu, Jianglin Lu, Dakota Murray


Abstract
Scientific citations carry rhetorical intent. Scholars may cite prior work positively (supporting), negatively (contrasting), or neutrally (mentioning). As large language models (LLMs) increasingly assist scientific writing, whether they reproduce citations with the same rhetorical intent as humans remains unclear. We introduce a masked-citation task to compare human and LLM-generated citation behavior. For each citation context, an LLM generates a replacement citation sentence, producing a counterfactual corpus directly comparable to human citation. We analyze what, whom, and how models cite, using an LLM-as-a-judge to classify citation intent and a 20-million-edge coauthorship network to measure social distance between cited authors. Across six popular LLMs and 1,746 top NLP conference papers (63k+ contexts, 132k+ citations), three patterns emerge: (1) Compared with human citation, LLMs cite significantly less critically; (2) LLMs over-cite popular and older papers, a tendency amplified for contrasting citations where human writing more often draws on recent, niche work; (3) Whereas humans often cite within their close social network, especially for supporting citations, LLMs tend to draw on more socially distant authors. Together, these differences are double-edged: LLM citation reaches beyond a scholar’s close collaborators while being less critical and amplifying visibility bias, reshaping the rhetoric and reach of scientific citation.
Anthology ID:
2026.emnlp-main.725
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
16853–16872
Language:
URL:
https://aclanthology.org/2026.emnlp-main.725/
DOI:
Bibkey:
Cite (ACL):
Yixuan Liu, Lin Chen, Zhuoqi Liu, Jianglin Lu, and Dakota Murray. 2026. Citing Less Critically: LLMs Reshape the Rhetoric and Reach of Scientific Citation. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 16853–16872, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Citing Less Critically: LLMs Reshape the Rhetoric and Reach of Scientific Citation (Liu et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.725.pdf