Show Me How You Cite: Citation Fidelity, Usage, and Topology in the Evidence Behavior of AI Scientific Writing

Jihwan Oh, Gyeonghun Sun, Jisoo Kim, Yuho Lee, Taewon Yun, Jisu Shin, Hwanjun Song


Abstract
Large language models (LLMs) are increasingly used in scientific writing, yet their citation behavior remains poorly understood. We introduce CiteSpectrum, a controlled dataset for analyzing citations across five levels of AI involvement, from LLM-Only generation to Human-Authored papers. Using citation-behavior features across fidelity, usage, and topology, we show that AI-generated papers differ from human-written papers in how citations are validated, grounded, used, and structurally organized. Even when retrieval and human guidance reduce ghost citations, AI-generated papers contain more unsupported claims, rely on front-section evidence, use citations more affirmatively, and form broader but less interconnected reference networks. Moreover, citation behavior alone enables a lightweight classifier to outperform strong text-based detectors, achieving 0.880 balanced accuracy and 0.944 AUROC. These results suggest that citation behavior provides a strong, interpretable signal of AI involvement beyond conventional textual patterns. The dataset is available at: https://github.com/DISL-Lab/CiteSpectrum-EMNLP26.
Anthology ID:
2026.emnlp-main.2063
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
46978–47004
Language:
URL:
https://aclanthology.org/2026.emnlp-main.2063/
DOI:
Bibkey:
Cite (ACL):
Jihwan Oh, Gyeonghun Sun, Jisoo Kim, Yuho Lee, Taewon Yun, Jisu Shin, and Hwanjun Song. 2026. Show Me How You Cite: Citation Fidelity, Usage, and Topology in the Evidence Behavior of AI Scientific Writing. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 46978–47004, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Show Me How You Cite: Citation Fidelity, Usage, and Topology in the Evidence Behavior of AI Scientific Writing (Oh et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.2063.pdf