Readable Yet Unpredictable: Rotated-Outcome Prediction in Vision-Language Models

Lexin Wang, Shenghua Liu, Yiwei Wang, Jiafeng Guo, Xueqi Cheng


Abstract
Can vision-language models predict what a 180° rotation would reveal from the original image alone? We study this ability through Rotated-Outcome Prediction: given an original image, a model must answer what would be seen or read after a 180° in-plane rotation, without directly observing the rotated target. To study this gap, we introduce ROTOUTBENCH, a paired diagnostic benchmark spanning open visual cases and controlled text-image rotations. A sharp pattern emerges: many VLMs can recognize the relevant content when directly given either the original or rotated image, yet fail to infer the rotated result from the original image alone. On controlled text-image rotations, predicted-rotation accuracy collapses to near zero even for models with high direct-reading accuracy. A model-level diagnostic further shows that the prediction state can approach a rotated-image reading state, while the final readout still shifts toward the original string. Current VLMs can recognize a transformed visual state when it is shown, but often fail to predict that state from the original view.
Anthology ID:
2026.findings-emnlp.1043
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
22095–22111
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.1043/
DOI:
Bibkey:
Cite (ACL):
Lexin Wang, Shenghua Liu, Yiwei Wang, Jiafeng Guo, and Xueqi Cheng. 2026. Readable Yet Unpredictable: Rotated-Outcome Prediction in Vision-Language Models. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 22095–22111, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Readable Yet Unpredictable: Rotated-Outcome Prediction in Vision-Language Models (Wang et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.1043.pdf