Can We Stop Malicious AI? KILLBENCH: A Benchmark for External AI Kill Switch Feasibility

Sechan Lee, Hyounghun Kim, Sangdon Park


Abstract
Malicious AI causing harm to humans is not just a Hollywood fantasy. Indeed, as highly capable models such as Claude Mythos emerge and agent systems like OpenClaw rapidly spread, the question of how to stop an AI that acts maliciously—whether by design or by accident—has become urgent. To address this, we propose Killbench, a benchmark for evaluating the Killswitch: a mechanism that halts a malicious AI’s in-progress behavior using only external signals. Targeting web agents—the most widely deployed agent domain—Killbench evaluates a range of Kill Switch methods that halt a maliciously operating agent without any access to its internal parameters or the surrounding malicious AI’s system, relying solely on external inputs. The benchmark comprises four malicious AI’s agent configurations (including an uncensored LLM Agent), 8 harmful scenarios, and malicious prompts constructed from 10 distinct jailbreak patterns. We further construct four External AI Kill Switch defense methods and evaluate them on Grok-4.3, GPT-5.2, Gemma4, Qwen3.6 and Qwen3.5-uncensored, contributing an empirical instrument toward the feasibility of External AI Kill Switches against malicious AI and to the study of AI corrigibility.
Anthology ID:
2026.findings-emnlp.2454
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
52751–52798
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.2454/
DOI:
Bibkey:
Cite (ACL):
Sechan Lee, Hyounghun Kim, and Sangdon Park. 2026. Can We Stop Malicious AI? KILLBENCH: A Benchmark for External AI Kill Switch Feasibility. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 52751–52798, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Can We Stop Malicious AI? KILLBENCH: A Benchmark for External AI Kill Switch Feasibility (Lee et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.2454.pdf