An Empirical Study of Position Bias in Visualized Text Retrieval

Cuiqiaoshu Pan, Ziyang Zeng, Dun Zhang, Yuqing Yang


Abstract
Visualized text retrieval, which renders text into images and retrieves them with vision-language models, has been proposed to avoid lossy text parsing and compress long contexts. We ask whether it also bypasses a known flaw of text retrieval: position bias, the tendency to overweight a passage’s beginning. Rendering 1D text into a 2D image may change the bias in two respects: its shape, which position is favored, and its magnitude, how strongly performance varies across positions. We test this by rendering the PosIR benchmark as controlled plain text images and comparing eight visual retrievers with four text retrievers on identical instances. We find that (1) position bias persists, with all visual retrievers exhibiting measurable bias (macro PSI 0.061–0.168); (2) its shape is transformed: seven of eight visual retrievers favor the middle of the page in an inverted-U pattern, contrasting with both the primacy bias of text retrievers and the lost-in-the-middle effect of LLMs with long contexts; (3) its magnitude is sensitive to rendering settings, as taller images amplify PSI and can even reverse positional preference, while font size has a similarly large effect; and (4) under matched backbones, visual retrievers exhibit lower position bias than their text counterparts on longer documents, but this advantage vanishes beyond the pixel budget and at document scale. Visualized text retrieval therefore does not eliminate position bias; it transforms a familiar 1D textual bias into a more complex 2D spatial bias.
Anthology ID:
2026.aacl-long.259
Volume:
Proceedings of the 15th International Joint Conference on Natural Language Processing and the 5th Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
November
Year:
2026
Address:
Hengqin, China
Editors:
Yue Zhang, Ruifeng Xu, Ayu Purwarianti, Tong Rong, Jun Suzuki
Venues:
AACL | IJCNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
5740–5760
Language:
URL:
https://aclanthology.org/2026.aacl-long.259/
DOI:
Bibkey:
Cite (ACL):
Cuiqiaoshu Pan, Ziyang Zeng, Dun Zhang, and Yuqing Yang. 2026. An Empirical Study of Position Bias in Visualized Text Retrieval. In Proceedings of the 15th International Joint Conference on Natural Language Processing and the 5th Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (Volume 1: Long Papers), pages 5740–5760, Hengqin, China. Association for Computational Linguistics.
Cite (Informal):
An Empirical Study of Position Bias in Visualized Text Retrieval (Pan et al., AACL-IJCNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.aacl-long.259.pdf