Out of Sight, Not Out of Mind: Unveiling Latent Attack in Latent-based Multi-Agent Systems

Chenxi Wang, Ruiyang Huang, Jiayan Sun, Lei Wei, Yifan Wu


Abstract
Latent-based multi-agent systems replace parts of explicit inter-agent communication with hidden representations, offering a new direction for efficient and flexible agent collaboration. However, moving coordination into latent space may also move attacks beyond the reach of visible-text inspection. In this paper, we study whether latent states can carry attack-associated information that remains effective during clean executions. To examine this question, we introduce a latent attack framework that reactivates attack-induced effects through latent interventions without reusing adversarial text. Extensive experiments show that the resulting latent attacks can substantially degrade task performance in clean executions, especially when applied to inter-agent KV-cache handoffs rather than local hidden states. Further control analyses indicate that this degradation cannot be reduced to arbitrary perturbations or invalid generation. Overall, our findings suggest that latent-based collaboration does not remove attack risk; it shifts part of the risk into less observable execution states, calling for safeguards beyond visible-text inspection.
Anthology ID:
2026.emnlp-main.2093
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
47668–47696
Language:
URL:
https://aclanthology.org/2026.emnlp-main.2093/
DOI:
Bibkey:
Cite (ACL):
Chenxi Wang, Ruiyang Huang, Jiayan Sun, Lei Wei, and Yifan Wu. 2026. Out of Sight, Not Out of Mind: Unveiling Latent Attack in Latent-based Multi-Agent Systems. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 47668–47696, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Out of Sight, Not Out of Mind: Unveiling Latent Attack in Latent-based Multi-Agent Systems (Wang et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.2093.pdf