I Know You Did Not Write That! A Sampling Based Watermarking Method for Identifying Machine Generated Text

Kaan Efe Keleş, Ömer Kaan Gürbüz, Mucahid Kutlu


Abstract
Potential harms of Large Language Models such as mass misinformation and plagiarism can be partially mitigated if there exists a reliable way to detect machine generated text. In this paper, we propose a new watermarking method to detect machine-generated texts. Our method embeds a unique pattern within the generated text, ensuring that while the content remains coherent and natural to human readers, it carries distinct markers that can be identified algorithmically. Specifically, we intervene with the token sampling process in a way which enables us to trace back our token choices during the detection phase. We show how watermarking affects textual quality and compare our proposed method with a state-of-the-art watermarking method in terms of robustness and detectability. Through extensive experiments, we demonstrate the effectiveness of our watermarking scheme in distinguishing between watermarked and non-watermarked text, achieving high detection rates while maintaining textual quality.
Anthology ID:
2025.genaidetect-1.11
Volume:
Proceedings of the 1stWorkshop on GenAI Content Detection (GenAIDetect)
Month:
January
Year:
2025
Address:
Abu Dhabi, UAE
Editors:
Firoj Alam, Preslav Nakov, Nizar Habash, Iryna Gurevych, Shammur Chowdhury, Artem Shelmanov, Yuxia Wang, Ekaterina Artemova, Mucahid Kutlu, George Mikros
Venues:
GenAIDetect | WS
SIG:
Publisher:
International Conference on Computational Linguistics
Note:
Pages:
140–149
Language:
URL:
https://aclanthology.org/2025.genaidetect-1.11/
DOI:
Bibkey:
Cite (ACL):
Kaan Efe Keleş, Ömer Kaan Gürbüz, and Mucahid Kutlu. 2025. I Know You Did Not Write That! A Sampling Based Watermarking Method for Identifying Machine Generated Text. In Proceedings of the 1stWorkshop on GenAI Content Detection (GenAIDetect), pages 140–149, Abu Dhabi, UAE. International Conference on Computational Linguistics.
Cite (Informal):
I Know You Did Not Write That! A Sampling Based Watermarking Method for Identifying Machine Generated Text (Keleş et al., GenAIDetect 2025)
Copy Citation:
PDF:
https://aclanthology.org/2025.genaidetect-1.11.pdf