Reflect to Inform: Boosting Multimodal Reasoning via Information-Gain-Driven Verification

Shuai Lv, Chang Liu, Feng Tang, Rui Chen, Yu-Jie Yuan, Aojun Zhou, Kui Zhang, Xi Yang, Yangqiu Song


Abstract
Multimodal Large Language Models (MLLMs) achieve strong multimodal reasoning performance, yet we identify a recurring failure mode in long-form generation: as outputs grow longer, models progressively drift away from image evidence and fall back on textual priors, resulting in ungrounded reasoning and hallucinations. Interestingly, Based on attention analysis, we find that MLLMs have a latent capability for late-stage visual verification that is present but not consistently activated. Motivated by this observation, we propose Visual Re-Examination (VRE), a self-evolving training framework that enables MLLMs to autonomously perform visual introspection during reasoning without additional visual inputs. Rather than distilling visual capabilities from a stronger teacher, VRE promotes iterative self-improvement by leveraging the model itself to generate reflection traces, making visual information actionable through information gain. Extensive experiments across diverse multimodal benchmarks demonstrate that VRE consistently improves reasoning accuracy and perceptual reliability, while substantially reducing hallucinations, especially in long-chain settings.
Anthology ID:
2026.emnlp-main.1193
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
27318–27342
Language:
URL:
https://aclanthology.org/2026.emnlp-main.1193/
DOI:
Bibkey:
Cite (ACL):
Shuai Lv, Chang Liu, Feng Tang, Rui Chen, Yu-Jie Yuan, Aojun Zhou, Kui Zhang, Xi Yang, and Yangqiu Song. 2026. Reflect to Inform: Boosting Multimodal Reasoning via Information-Gain-Driven Verification. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 27318–27342, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Reflect to Inform: Boosting Multimodal Reasoning via Information-Gain-Driven Verification (Lv et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.1193.pdf