StealthRL: Reinforcement Learning Paraphrase Attacks for Multi-Detector Evasion of AI-Text Detectors

Suraj Ranganath, Atharv Ramesh


Abstract
AI-text detectors are increasingly used in high-stakes settings, but their robustness to meaning-preserving adversarial rewriting remains unclear. We introduce StealthRL, a reinforcement learning framework for stress-testing detectors with adaptive paraphrase attacks. StealthRL trains a paraphrase policy against a detector ensemble while enforcing semantic fidelity, then evaluates transfer to held-out detector families on the full filtered MAGE test pool. Across RoBERTa, Fast-DetectGPT, Binoculars, and MAGE, the resulting attack sharply degrades detection performance, driving mean TPR@1%FPR down to 0.024 while retaining nontrivial semantic overlap and readable prose. The attack also transfers to detectors not used during training, indicating a broader robustness failure rather than overfitting to a single target model. We complement the main results with detector-score analysis, repeated-generation stability checks, and automatic and judge-based quality evaluation. Our findings suggest that current AI-text detectors remain brittle under adaptive paraphrasing pressure and motivate robustness evaluation at deployment-relevant operating points. Our code and the trained model checkpoint are publicly available.
Anthology ID:
2026.plurvallm-1.1
Volume:
Proceedings of the First Workshop on Pluralistic Value Alignment of LLMs
Month:
November
Year:
2026
Address:
Hengqin, China
Editors:
Deyi Xiong, António Branco, Hongming Zhang, Yue Dong, Benyou Wang, Wenxuan Zhang, Li Zhou, Jingting Zheng
Venues:
PlurVA-LLM | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1–16
Language:
URL:
https://aclanthology.org/2026.plurvallm-1.1/
DOI:
Bibkey:
Cite (ACL):
Suraj Ranganath and Atharv Ramesh. 2026. StealthRL: Reinforcement Learning Paraphrase Attacks for Multi-Detector Evasion of AI-Text Detectors. In Proceedings of the First Workshop on Pluralistic Value Alignment of LLMs, pages 1–16, Hengqin, China. Association for Computational Linguistics.
Cite (Informal):
StealthRL: Reinforcement Learning Paraphrase Attacks for Multi-Detector Evasion of AI-Text Detectors (Ranganath & Ramesh, PlurVA-LLM 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.plurvallm-1.1.pdf