Send a SCOUT First: Pre-hoc Reasoning for Adaptive Detector Allocation in Prompt-Injection Defense

Shuhao Zhang, Jiarui Li, Qi Cao, Ruiyi Zhang, Pengtao Xie


Abstract
Prompt-injection detectors are heterogeneous: each is strong on a different slice of attacks, and none is always reliable. Yet existing systems still treat detection as a fixed single-detector pipeline, committing every request to one detector’s blind spots. We reframe defense as *detector allocation*: given a heterogeneous pool, decide per request which detectors to run and whether to escalate to an LLM judge. Our framework **SCOUT** (**S**calable and **C**ontrollable **O**utcome-prediction for **U**ncertainty-aware **T**riage) makes this decision dynamic by predicting each detector’s per-sample reliability and latency from how it behaved on similar past inputs, and exposes a single safety-utility threshold to the operator (where utility bundles benign-pass rate and wall-clock). To evaluate this setting, we build SCOUT-450, a benchmark that captures the structurally complex, agent-facing injections that older prompt-injection sets under-represent. On SCOUT-450, a safety-oriented operating point reduces attack-success rate by **46%** and total wall-clock by **40%** relative to an always-on GPT-4o judge, at a **5.1**-point benign-utility drop. SCOUT also transfers to three external benchmarks (BIPIA, IPI, and IHEval), improving the safety-utility frontier.
Anthology ID:
2026.emnlp-main.1598
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
36314–36351
Language:
URL:
https://aclanthology.org/2026.emnlp-main.1598/
DOI:
Bibkey:
Cite (ACL):
Shuhao Zhang, Jiarui Li, Qi Cao, Ruiyi Zhang, and Pengtao Xie. 2026. Send a SCOUT First: Pre-hoc Reasoning for Adaptive Detector Allocation in Prompt-Injection Defense. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 36314–36351, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Send a SCOUT First: Pre-hoc Reasoning for Adaptive Detector Allocation in Prompt-Injection Defense (Zhang et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.1598.pdf