Opacity Is Not Privacy: Information-Constrained Latent Communication for Multi-Agent LLM Systems

Yao Gong, Long Xiang, Di Liang, Peiyang Liu, Zekai Lin, Mengze Hong, Xianjie Wu, Minlong Peng


Abstract
Latent communication provides an efficient alternative to text-based exchange in multi-agent LLM systems by transmitting continuous hidden representations instead of natural-language messages. However, opacity is not privacy: latent messages may still carry private prompts, agent memory, or task-irrelevant sensitive information recoverable by downstream agents or adversaries. We study this risk through communicated latent messages, the edge-level representations that cross agent boundaries and define the privacy interface of latent multi-agent systems. We identify two coupled leakage mechanisms: instantaneous leakage from individual messages and propagation leakage accumulated across multi-round transcripts.

We propose Information-Constrained Latent Communication (ICLC), a model-agnostic communication-layer framework that constrains latent information exposure without modifying backbone LLM parameters. ICLC combines a receiver-conditioned latent bottleneck, adversarial regularization over messages and transcripts, and topology-aware gates that suppress unnecessary communication edges. Across private-context question answering, collaborative reasoning, and tool-use planning, ICLC preserves the utility benefit of latent communication while reducing average leakage from 0.747 to 0.398 compared with raw latent communication. These results suggest that privacy in latent multi-agent systems should be treated as a dynamic information-flow problem over messages, edges, and interaction rounds.
Anthology ID:
2026.emnlp-main.2186
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
49695–49717
Language:
URL:
https://aclanthology.org/2026.emnlp-main.2186/
DOI:
Bibkey:
Cite (ACL):
Yao Gong, Long Xiang, Di Liang, Peiyang Liu, Zekai Lin, Mengze Hong, Xianjie Wu, and Minlong Peng. 2026. Opacity Is Not Privacy: Information-Constrained Latent Communication for Multi-Agent LLM Systems. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 49695–49717, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Opacity Is Not Privacy: Information-Constrained Latent Communication for Multi-Agent LLM Systems (Gong et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.2186.pdf