Beyond Static Visual Tokens: Structured Sequential Visual Chain-of-Thought Reasoning

Guangfu Guo, Xiaoqian Lu, Yue Feng, Mingming Sun


Abstract
Current multimodal LLMs encode images as static visual prefixes and rely on text-based reasoning, lacking goal-driven and adaptive visual access. Inspired by human visual perception—where attention is selectively and sequentially shifted from the most informative regions to secondary cues—we propose Structural Sequential Visual CoT **(SSV-CoT)**. First, a question-relevant saliency map identifies and organizes key visual regions, explicitly modeling the spatial distribution of visual importance. Second, reasoning is performed following this discriminative order, inducing a curriculum-like semantic progression from primary to secondary cues. This method is trained end-to-end, using text cot and answer supervision, without relying on region-level annotations or specialized external tools. Experiments on diverse visual reasoning benchmarks show gains, validating structured and sequential visual cognition.
Anthology ID:
2026.findings-emnlp.1921
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
40959–40974
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.1921/
DOI:
Bibkey:
Cite (ACL):
Guangfu Guo, Xiaoqian Lu, Yue Feng, and Mingming Sun. 2026. Beyond Static Visual Tokens: Structured Sequential Visual Chain-of-Thought Reasoning. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 40959–40974, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Beyond Static Visual Tokens: Structured Sequential Visual Chain-of-Thought Reasoning (Guo et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.1921.pdf