Look Where It Matters: High-Resolution Crops Retrieval for Efficient VLMs

Nimrod Shabtay, Moshe Kimhi, Sivan Harary, Artem Spector, Ehud Rivlin, Chaim Baskin, Raja Giryes, Eli Schwartz


Abstract
Vision-language models (VLMs) typically process images at a native high-resolution, forcing a trade-off between accuracy and computational efficiency: high-resolution inputs capture fine details but incur significant computational costs, while low-resolution inputs advocate for efficiency, they potentially miss critical visual information, specifically OCR related. We present AwaRes, a spatial-on-demand framework that resolves this accuracy–efficiency trade-off by operating on a low-resolution global view and using tool-calling to retrieve only high-resolution segment needed for a given query, rather than escalating to the full image. We construct this supervision automatically: a judge compares low- vs. high-resolution answers to label whether cropping is needed, and an oracle grounding model localizes the evidence for the correct answer, which we map to a discrete crop set to form multi-turn tool-use trajectories. We train our framework with SFT followed by multi-turn GRPO with a composite reward that combines semantic answer correctness with explicit crop-cost penalties. AwaRes provides a practical, deployment-friendly path to high-detail VLM reasoning under tight compute budgets.
Anthology ID:
2026.docinsights-1.25
Volume:
The Proceedings of Workshop on Document Intelligence and Understanding
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Santosh T.Y.S.S., Amit Agarwal, Vivek Gupta, Yova Kementchedjhieva, Aparna Garimella, Yufang Hou
Venues:
DocInsights | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
357–384
Language:
URL:
https://aclanthology.org/2026.docinsights-1.25/
DOI:
Bibkey:
Cite (ACL):
Nimrod Shabtay, Moshe Kimhi, Sivan Harary, Artem Spector, Ehud Rivlin, Chaim Baskin, Raja Giryes, and Eli Schwartz. 2026. Look Where It Matters: High-Resolution Crops Retrieval for Efficient VLMs. In The Proceedings of Workshop on Document Intelligence and Understanding, pages 357–384, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Look Where It Matters: High-Resolution Crops Retrieval for Efficient VLMs (Shabtay et al., DocInsights 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.docinsights-1.25.pdf