The Impostors Method as a Statistical Test for Authorship Verification With Large Language Models as Sampling Source for Hard Negatives

Klara M. Gutekunst, Yaron Winter, Martin Potthast


Abstract
Authorship verification asks whether two given texts were written by the same author. Since supervised verification methods often generalize poorly across domains, the unsupervised Impostors Method, inspired by police lineups, reduces verification to in-domain authorship attribution. Using one text as a query, it hides the other among a sample of hard negatives and measures how reliably a style similarity function retrieves it at the top rank. Although widely applied in practice, the Impostors Method still suffers when no in-domain impostor documents are available. Resorting instead to sampling from open-domain collections provides much less control over confounding stylistic variables such as genre or register. Moreover, its statistical foundations remain largely unexplored compared with those of police lineups. In this paper, we recast the Impostors Method as a statistical hypothesis test, enabling a principled assessment of evidential strength without training a decision threshold. We further investigate large language models (LLMs) as a controllable source for generating in-domain impostor documents.
Anthology ID:
2026.findings-emnlp.164
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
3473–3499
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.164/
DOI:
Bibkey:
Cite (ACL):
Klara M. Gutekunst, Yaron Winter, and Martin Potthast. 2026. The Impostors Method as a Statistical Test for Authorship Verification With Large Language Models as Sampling Source for Hard Negatives. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 3473–3499, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
The Impostors Method as a Statistical Test for Authorship Verification With Large Language Models as Sampling Source for Hard Negatives (Gutekunst et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.164.pdf