Why Prompt-Injection Detectors Fail on XPIA: A Latent-Space Explanation

Yash Narendra, Niladri Chatterjee


Abstract
Prompt-injection detectors often fail on **cross-prompt-injection attacks (XPIA)**, where the adversarial instruction is hidden inside a document, email, webpage, or tool output. This paper argues that the failure is not only a **distribution-shift problem**, but also a **representation-level problem**. Inside the hidden states of frozen detector backbones, user prompt-injection attacks (UPIA) and XPIA are encoded along **distinct, weakly aligned directions**. A detector whose readout is primarily aligned with the UPIA direction can therefore miss the XPIA signal, even though both signals are present in the same model’s representation. A **two-axis linear-discriminant probe** recovers this missing signal: UPIA attacks fire the UPIA axis in **99.9%** of caught cases, while XPIA attacks fire the XPIA axis in **97.3%** of caught cases. Axis ablations and activation-level steering suggest that these directions are not only predictive but may also be behaviorally relevant under controlled perturbations. The geometry persists across model families, training stages, scales, and external prompt-injection benchmarks, suggesting that **XPIA should be treated as a distinct threat axis rather than as a harder version of UPIA**.
Anthology ID:
2026.findings-emnlp.1103
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
23326–23344
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.1103/
DOI:
10.18653/2026.findings-emnlp.1103
Bibkey:
Cite (ACL):
Yash Narendra and Niladri Chatterjee. 2026. Why Prompt-Injection Detectors Fail on XPIA: A Latent-Space Explanation. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 23326–23344, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Why Prompt-Injection Detectors Fail on XPIA: A Latent-Space Explanation (Narendra & Chatterjee, Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.1103.pdf