Decompose, Look, and Reason: Reinforced Latent Reasoning for VLMs

Mengdan Zhu, Senhao Cheng, Liang Zhao


Abstract
Vision-Language Models often struggle with complex visual reasoning due to the visual information loss in textual CoT. Existing methods either add the cost of tool calls or rely on localized patch-based embeddings that are insufficient to extract semantics in multi-step reasoning. We propose "Decompose, Look, and Reason" (DLR), a reinforced latent reasoning framework that dynamically decomposes queries into textual premises, extracts premise-conditioned continuous visual latents, and deduces answers through grounded rationales. We introduce a three-stage training pipeline and propose a novel Spherical Gaussian Latent Policy, to enable effective exploration in the latent space. Extensive experiments on vision-centric benchmarks show that DLR consistently outperforms strong baselines, including text-only, interleaved multimodal CoT, and latent reasoning methods, while providing superior stepwise interpretability.
Anthology ID:
2026.emnlp-main.64
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
1459–1471
Language:
URL:
https://aclanthology.org/2026.emnlp-main.64/
DOI:
Bibkey:
Cite (ACL):
Mengdan Zhu, Senhao Cheng, and Liang Zhao. 2026. Decompose, Look, and Reason: Reinforced Latent Reasoning for VLMs. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 1459–1471, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Decompose, Look, and Reason: Reinforced Latent Reasoning for VLMs (Zhu et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.64.pdf