Detector-Evasive LLM Paraphrasing via Constrained Policy Optimization

Mingyi Wang, Zhuoer Shen, Yuheng Bu, Shaofeng Zou


Abstract
AI-text detectors are vulnerable to paraphrasing and detector-guided paraphrasing attacks, but existing detector-evasion methods often lack precise control over semantic preservation. In particular, optimizing directly for detector evasion can degrade fine-grained semantics, whereas scalarized reward designs provide only indirect, weight-sensitive control over the evasion–semantics trade-off. We address this limitation by formulating detector-evasive LLM paraphrasing as a Constrained Markov Decision Process, where detector evasion is the primary objective and semantic preservation is enforced as an explicit constraint. We propose Detector Evasion Policy Optimization (DEPO), a Lagrangian primal-dual reinforcement learning algorithm with a novel GRPO-style group-based policy update. DEPO adaptively balances semantic preservation and detector evasion during training, enabling the policy to improve attack success within a prescribed semantic-preservation region. Experiments on MAGE, M4, RAID, and peer-review datasets, evaluated against MAGE, RoBERTa, RADAR, Binoculars, and Fast-DetectGPT detectors, show that DEPO achieves strong detector evasion while precisely satisfying the semantic preservation constraint. DEPO also exhibits cross-domain, cross-detector, and prompt-level robustness.
Anthology ID:
2026.findings-emnlp.1361
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
28889–28914
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.1361/
DOI:
Bibkey:
Cite (ACL):
Mingyi Wang, Zhuoer Shen, Yuheng Bu, and Shaofeng Zou. 2026. Detector-Evasive LLM Paraphrasing via Constrained Policy Optimization. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 28889–28914, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Detector-Evasive LLM Paraphrasing via Constrained Policy Optimization (Wang et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.1361.pdf