ReViCo: Unveiling the Limitations of VLMs in Visual Text Understanding via Error Correction

Bojun Zhang, Junhong Liang, Feifei Zhai, Fengxian Ji, Yu Zhou


Abstract
Vision Language Models (VLMs) have shown great success in general visual tasks, yet they still struggle to deeply understand text within images. In this paper, we introduce **ReViCo** (**Re**al **Vi**sual **Co**rrection), a benchmark designed to evaluate VLM text understanding through a novel task of visual text error correction. ReViCo challenges models with identifying and fixing text errors in real-world images, which requires a deep understanding on visual text. We benchmark various VLMs using two distinct paradigms: prompt-based strategy and targeted model training, both aimed at pushing the limits of current models. Our experiments reveal a striking performance gap between even the best VLMs and human, and further analysis also shows that most models struggle to accurately perceive the visual text, resulting in frequent correction errors. By highlighting these gaps, ReViCo provides a new benchmark foundation for developing more robust and text-aware VLMs.
Anthology ID:
2026.emnlp-main.845
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
19606–19622
Language:
URL:
https://aclanthology.org/2026.emnlp-main.845/
DOI:
Bibkey:
Cite (ACL):
Bojun Zhang, Junhong Liang, Feifei Zhai, Fengxian Ji, and Yu Zhou. 2026. ReViCo: Unveiling the Limitations of VLMs in Visual Text Understanding via Error Correction. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 19606–19622, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
ReViCo: Unveiling the Limitations of VLMs in Visual Text Understanding via Error Correction (Zhang et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.845.pdf