Seeing Before Agreeing: Aligning Multi-Agent Consensus with Visual Evidence

Yuhan Wang, Shuochen Chang, Yalin Feng, Dongsheng Ma, Yuanzi Li, Zhengren Wang, Yinglong Yang, Yufei Chen, Yikang Wang, Shaoxu Sun, Wentao Zhang


Abstract
Vision-language models (VLMs) have achieved strong performance on visual question answering (VQA). To mitigate individual hallucinations and blind spots, aggregating diverse perspectives via multi-agent collaboration has emerged as a promising paradigm. While this approach has shown great success in textual QA, its potential in the multimodal domain remains under-explored. Existing multi-agent VQA methods predominantly adapt text-centric protocols, focusing on textual discussions while ignoring the alignment of visual information. In this work, we reveal a key insight: answer-level agreement is insufficient for reliable multi-agent VQA; *aligned visual evidence*—shared support from the image regions agents rely on—is essential for trustworthy consensus. To leverage this insight, we propose **EAGLE** (**E**vidence-**A**ligned **G**rounded mu**L**ti-agent r**E**asoning), a training-free evidence-centered framework for coordinating multiple VLM agents. **EAGLE** explicitly exposes each agent’s grounding regions as visual evidence, enables mutual verification over the evidence, and uses evidence consistency to guide final decision-making. Experiments on six VQA benchmarks show that **EAGLE** achieves best average performance across domains while remaining lightweight, interpretable, and practical for deployment.
Anthology ID:
2026.findings-emnlp.473
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
9925–9952
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.473/
DOI:
Bibkey:
Cite (ACL):
Yuhan Wang, Shuochen Chang, Yalin Feng, Dongsheng Ma, Yuanzi Li, Zhengren Wang, Yinglong Yang, Yufei Chen, Yikang Wang, Shaoxu Sun, and Wentao Zhang. 2026. Seeing Before Agreeing: Aligning Multi-Agent Consensus with Visual Evidence. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 9925–9952, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Seeing Before Agreeing: Aligning Multi-Agent Consensus with Visual Evidence (Wang et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.473.pdf