RGCC: Retriever-Guided Context Compression for Efficient Vision–Language Alignment in Knowledge-Based VQA

Qiankun Li, Feifei Zhai, Jianghao Chen, Chong Li, Haoran Gao, Fanyu Meng, Junlan Feng, Yang Zhao, Yu Zhou


Abstract
Knowledge-Based Visual Question Answering (KB-VQA) requires retrieving external textual knowledge to answer visual queries. However, current methods often suffer from two critical misalignments during retrieval: distributional misalignment, driven by the severe stylistic shift from descriptive pre-training image captions to formal knowledge texts, and granularity misalignment, where lengthy knowledge documents contain excessive noise that drowns out key information, making it difficult to accurately match the visual query. To resolve these challenges, we propose RGCC, a Retriever-Guided Context Compression framework. By mining alignment-friendly data and further training a context compression model, RGCC condenses lengthy documents into compact, retriever-preferred representations that significantly improve cross-modal retrieval. Extensive experiments on the InfoSeek and E-VQA benchmarks demonstrate that RGCC achieves state-of-the-art retrieval performance and boosts downstream question-answering accuracy without additional online inference overhead.
Anthology ID:
2026.findings-emnlp.682
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
14313–14335
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.682/
DOI:
Bibkey:
Cite (ACL):
Qiankun Li, Feifei Zhai, Jianghao Chen, Chong Li, Haoran Gao, Fanyu Meng, Junlan Feng, Yang Zhao, and Yu Zhou. 2026. RGCC: Retriever-Guided Context Compression for Efficient Vision–Language Alignment in Knowledge-Based VQA. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 14313–14335, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
RGCC: Retriever-Guided Context Compression for Efficient Vision–Language Alignment in Knowledge-Based VQA (Li et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.682.pdf