Who Wrote the Book? Detecting and Attributing LLM Ghostwriters

Anudeex Shetty, Qiongkai Xu, Olga Ohrimenko, Jey Han Lau


Abstract
Out-of-distribution (OOD) generalisation is essential for authorship attribution (AA), especially when involving new authors, yet this aspect remains insufficiently supported by existing AA datasets. In this paper, we introduce GHOSTWRITEBENCH, a dataset for LLM AA task, designed to test generalisation across multiple OOD dimensions, including unseen domain and authors. GHOSTWRITEBENCH comprises long-form texts (50K+ words per book) generated by ten frontier LLMs. We find that existing methods degrade substantially in unseen author scenarios — dropping by as much as 70% even under high-resource settings. We propose TRACE, a novel lightweight and interpretable fingerprinting method that captures token-level transition patterns (i.e., word rank and entropy) using a lightweight language model. Experiments show robustness of TRACE in OOD settings and establish it as a strong baseline on GHOSTWRITEBENCH.
Anthology ID:
2026.emnlp-main.2525
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
57419–57447
Language:
URL:
https://aclanthology.org/2026.emnlp-main.2525/
DOI:
Bibkey:
Cite (ACL):
Anudeex Shetty, Qiongkai Xu, Olga Ohrimenko, and Jey Han Lau. 2026. Who Wrote the Book? Detecting and Attributing LLM Ghostwriters. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 57419–57447, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Who Wrote the Book? Detecting and Attributing LLM Ghostwriters (Shetty et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.2525.pdf