Perceive, Localize, Reflect: Evidence-Anchored Multi-Agent Debate for MLLM Hallucination Mitigation

Yebo Wu, Han Jin, Wei Yang Bryan Lim, Li Li


Abstract
Multimodal Large Language Models (MLLMs) demonstrate remarkable reasoning capabilities, yet they remain susceptible to hallucinations. While Multi-Agent Debate (MAD) presents a promising collaborative solution, unguided debates inevitably devolve into a stochastic martingale process and expanding conversational contexts trigger severe visual attention decay. In this paper, we propose EviaMAD, an Evidence-Anchored Multi-Agent Debate framework. To proactively expose internal hallucinations, EviaMAD bifurcates perception into two distinct roles: a Global Observer capturing the holistic scene and a Local Observer scrutinizing salient details. When conflicts arise, a dedicated Analyzer intervenes, distilling the linguistic disagreement into a deterministic bimodal evidence anchor: a physically cropped visual patch of the disputed region paired with key semantic directives. During the subsequent reflection phase, a surgical reallocation mechanism explicitly amplifies the attention weights of this anchor. By compelling agents to ground their reasoning in strictly verified evidence, EviaMAD effectively elicits collective intelligence. Extensive evaluations demonstrate that EviaMAD significantly mitigates hallucinations while elevating the reasoning capabilities of the multi-agent system.
Anthology ID:
2026.emnlp-main.1597
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
36298–36313
Language:
URL:
https://aclanthology.org/2026.emnlp-main.1597/
DOI:
Bibkey:
Cite (ACL):
Yebo Wu, Han Jin, Wei Yang Bryan Lim, and Li Li. 2026. Perceive, Localize, Reflect: Evidence-Anchored Multi-Agent Debate for MLLM Hallucination Mitigation. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 36298–36313, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Perceive, Localize, Reflect: Evidence-Anchored Multi-Agent Debate for MLLM Hallucination Mitigation (Wu et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.1597.pdf