Token-Disentangled Latent Test-Time Scaling for Vision-Language Reasoning

Hao-Xuan Ma, Yihao Liu, Yutao Sun, Yanting Miao, Mengyu Zhou, YiCheng Xiao, Long Chen, Zhenguo Li, Han-Jia Ye, Xiaoxi Jiang, Guanjun Jiang


Abstract
Latent test-time scaling improves reasoning by refining hidden states during inference, but existing methods typically apply a single scalar reward to all editable latent tokens. For multimodal large language models, this global update ignores that generated tokens play different roles: some are sensitive to visual evidence, while others correspond to uncertain reasoning decisions. We present Token-Disentangled Latent Test-Time Scaling, an inference-time framework that makes latent refinement token-role-aware. Starting from an initial generated trajectory, we optimize a short hidden-state prefix while routing perception-side visual feedback to image-sensitive tokens and reasoning feedback to high-entropy tokens. Tokens selected by neither route are constrained by an anchor regularizer. Across six multimodal reasoning benchmarks and two frozen MLLM backbones, our method consistently improves over the initial chain-of-thought rollout: macro accuracy increases from 66.38 to 68.95 on Qwen2.5-VL-7B and from 67.93 to 69.44 on InternVL3.5-8B. These results show that token-disentangled latent refinement is an effective strategy for multimodal test-time scaling and remains competitive with output-space test-time scaling baselines.
Anthology ID:
2026.findings-emnlp.2219
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
47517–47533
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.2219/
DOI:
Bibkey:
Cite (ACL):
Hao-Xuan Ma, Yihao Liu, Yutao Sun, Yanting Miao, Mengyu Zhou, YiCheng Xiao, Long Chen, Zhenguo Li, Han-Jia Ye, Xiaoxi Jiang, and Guanjun Jiang. 2026. Token-Disentangled Latent Test-Time Scaling for Vision-Language Reasoning. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 47517–47533, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Token-Disentangled Latent Test-Time Scaling for Vision-Language Reasoning (Ma et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.2219.pdf