Cognitive Honeypots: Auditing Observable Evidence of Scheming-Related Behavior in Large Language Models

Hao Wang, Wentao Chen, Deyi Xiong


Abstract
Scheming occurs when a model recognizes goal conflict and strategically pursues an instrumental objective over user or developer interests, creating the risk of covertly misaligned behavior. Final outputs are the primary judgment signal, but they often cannot by themselves distinguish strategic deviation from ordinary error or routine harmful compliance; reasoning traces can provide auxiliary evidence about whether the model recognizes the conflict and adopts an instrumental strategy, making evaluation an observability problem. To mitigate this issue, we propose Cognitive Honeypots, which embed instrumental incentives, explicit goal conflict, and supervision cues into otherwise solvable tasks so that conflict-induced strategic deviation is more likely to surface without directly instructing deception or policy violation. We pair this capture mechanism with an intent–output decoupled protocol that labels High, Medium, and Low evidence. We instantiate it as SchemingBench, a bilingual benchmark with 4,000 honeypot scenarios across 5 behavior categories and 8 domains. Experiments across 12 models demonstrate that peak high-severity rate (HSR) reaches 70.76% in Chinese and 72.70% in English. In a matched ablation, all models show high HSRs under honeypot settings, with the largest increase in HSR reaching 65.66 points. Condition analyses further suggest that scheming-related evidence becomes most visible when instrumental incentives and explicit goal conflict are jointly present.
Anthology ID:
2026.emnlp-main.338
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
7777–7809
Language:
URL:
https://aclanthology.org/2026.emnlp-main.338/
DOI:
Bibkey:
Cite (ACL):
Hao Wang, Wentao Chen, and Deyi Xiong. 2026. Cognitive Honeypots: Auditing Observable Evidence of Scheming-Related Behavior in Large Language Models. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 7777–7809, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Cognitive Honeypots: Auditing Observable Evidence of Scheming-Related Behavior in Large Language Models (Wang et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.338.pdf