LaRe: Latent Refocusing for Multimodal Reasoning

Jizheng Ma, Xiaofei Zhou, Geyuan Zhang, Yanlong Song, Han Yan


Abstract
Chain of Thought (CoT) reasoning enhances logical performance by decomposing complex tasks, yet its multimodal extension faces a trade-off. The existing thinking with images paradigm is limited by the modality gap between vision and language, which hinders reliable extraction of reasoning relevant information from high dimensional visual data. Recent latent space reasoning method provides stronger multimodal representations, but it often lacks the ability to refocus on visual inputs and suffers from limited interpretability. To address these issues, we proposeLatent Refocusing (LaRe), a novel multimodal reasoning paradigm that combines visual refocusing with rich latent representations, enabling iterative reasoning within the latent space. We further design a semantic augmentation training strategy that ensures the semantic structure of the latent space through visual reconstruction objective. Experimental evaluations demonstrate that LaRe improves average accuracy by 7.6% compared to existing baselines while reducing the number of tokens required for inference by 59.7%. When scaled to a 8B-parameter Vision-Language Model backbone, LaRe achieves performance comparable to state-of-the-art methods, demonstrating the efficacy of our proposed latent refocusing paradigm for multimodal reasoning.
Anthology ID:
2026.findings-emnlp.181
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
3847–3868
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.181/
DOI:
Bibkey:
Cite (ACL):
Jizheng Ma, Xiaofei Zhou, Geyuan Zhang, Yanlong Song, and Han Yan. 2026. LaRe: Latent Refocusing for Multimodal Reasoning. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 3847–3868, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
LaRe: Latent Refocusing for Multimodal Reasoning (Ma et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.181.pdf