CGVR: Contradiction-Guided Visual Reasoning for Mitigating Hallucinations in Multimodal Large Language Models

Haoran Ding, Wanqi Zhou, Lei Xing, Lujuan Dang, Kaizhong Zheng, Badong Chen


Abstract
Multimodal Large Language Models (MLLMs) frequently suffer from object hallucination, producing descriptions or answers unsupported by visual evidence, which undermines their reliability in real-world applications. This paper begins with an intriguing phenomenon: prefacing queries with statements explicitly contradicting image content often yields more accurate responses than direct questioning. We term this the Contradictory Prompting Effect (CPE). Priming inputs with assertions opposing reality triggers an intrinsic self-verification mechanism within MLLMs, where conflicting claims compel the model to prioritize visual evidence over linguistic priors. Inspired by this discovery, we propose Contradiction-Guided Visual Reasoning (CGVR), a novel training-free framework for hallucination mitigation. CGVR systematically generates deliberate contradictory captions alongside standard ones. These captions drive a dual-channel inference process, in which conflicting signals enforce rigorous cross-checking against visual evidence. Our work reveals MLLMs’ latent self-verification capability triggered by contradictions and establishes a paradigm for lightweight, reliable multimodal reasoning. Extensive evaluations on POPE and MME benchmarks demonstrate that our proposed CGVR significantly mitigates hallucinations across diverse MLLMs. Our code is available at https://github.com/dhr1698/CGVR.
Anthology ID:
2026.aacl-long.197
Volume:
Proceedings of the 15th International Joint Conference on Natural Language Processing and the 5th Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
November
Year:
2026
Address:
Hengqin, China
Editors:
Yue Zhang, Ruifeng Xu, Ayu Purwarianti, Tong Rong, Jun Suzuki
Venues:
AACL | IJCNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
4375–4387
Language:
URL:
https://aclanthology.org/2026.aacl-long.197/
DOI:
Bibkey:
Cite (ACL):
Haoran Ding, Wanqi Zhou, Lei Xing, Lujuan Dang, Kaizhong Zheng, and Badong Chen. 2026. CGVR: Contradiction-Guided Visual Reasoning for Mitigating Hallucinations in Multimodal Large Language Models. In Proceedings of the 15th International Joint Conference on Natural Language Processing and the 5th Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (Volume 1: Long Papers), pages 4375–4387, Hengqin, China. Association for Computational Linguistics.
Cite (Informal):
CGVR: Contradiction-Guided Visual Reasoning for Mitigating Hallucinations in Multimodal Large Language Models (Ding et al., AACL-IJCNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.aacl-long.197.pdf