Sorry Robot, Happy Human: Vision-Language Models Read Only One of Two Legible Typographic Layers

Mert İncidelen, Yamen Kashkash, Asya Berker, Murat Aydogan


Abstract
Vision-language models (VLMs), despite their success in optical character recognition (OCR) tasks, are vulnerable to typographic attacks and have a fragile structure for images with multiple text layers. In this study, the DecoyBench dataset was created using the Decoy Font method. The dataset consists of 300 images, each containing text with sharp contour lines superimposed on another text with soft shading. Six recent closed-source models from three different model families were evaluated using this dataset under two different prompting conditions (naive and guided) and at two different resolutions (512 × 512 and 64 × 64). A validation study showed that human participants could read both text layers with high accuracy. In contrast, the models, with most variants and both prompting methods, read the contour text with near-human accuracy at high resolution, but almost never fully extracted the shading text. At low resolution, the contour text could not be read by either the models or humans, while the shading text could be extracted with high accuracy. The findings indicate that the evaluated VLMs exhibit a consistent behavioral limitation when processing typographic structures containing multiple spatial frequency layers.
Anthology ID:
2026.docinsights-1.20
Volume:
The Proceedings of Workshop on Document Intelligence and Understanding
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Santosh T.Y.S.S., Amit Agarwal, Vivek Gupta, Yova Kementchedjhieva, Aparna Garimella, Yufang Hou
Venues:
DocInsights | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
282–286
Language:
URL:
https://aclanthology.org/2026.docinsights-1.20/
DOI:
Bibkey:
Cite (ACL):
Mert İncidelen, Yamen Kashkash, Asya Berker, and Murat Aydogan. 2026. Sorry Robot, Happy Human: Vision-Language Models Read Only One of Two Legible Typographic Layers. In The Proceedings of Workshop on Document Intelligence and Understanding, pages 282–286, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Sorry Robot, Happy Human: Vision-Language Models Read Only One of Two Legible Typographic Layers (İncidelen et al., DocInsights 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.docinsights-1.20.pdf