GraphER: An Efficient Graph-Based Enrichment and Reranking Method for Retrieval-Augmented Generation

Ruizhong Miao, Yuying Wang, Rongguang Wang, Chenyang Li, Tao Sheng, Sujith Ravi, Dan Roth


Abstract
Semantic search in retrieval-augmented generation (RAG) systems is often insufficient for complex information needs, particularly when relevant evidence is scattered across multiple sources, because it may fail to retrieve the complete set of evidence. Existing approaches to addressing this problem either rely on iterative agentic retrieval, which can be computationally inefficient, or maintain additional structures such as knowledge graphs, which introduce storage and maintenance overhead. In this paper, we propose GraphER, a graph-based enrichment and reranking framework that (1) leverages the organizational structure of data to capture proximity relationships beyond semantic similarity, (2) constructs a graph at query time based on these proximities, and (3) applies graph-based ranking to surface the top candidate documents. Experiments across table retrieval, multi-hop retrieval, and long-document retrieval benchmarks demonstrate consistent improvements in terms of retrieval completeness. Additionally, GraphER requires no additional graph infrastructure and integrates seamlessly with standard vector stores. The framework is retriever-agnostic, supports multiple forms of proximity, and introduces minimal query-time latency.
Anthology ID:
2026.docinsights-1.8
Volume:
The Proceedings of Workshop on Document Intelligence and Understanding
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Santosh T.Y.S.S., Amit Agarwal, Vivek Gupta, Yova Kementchedjhieva, Aparna Garimella, Yufang Hou
Venues:
DocInsights | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
100–111
Language:
URL:
https://aclanthology.org/2026.docinsights-1.8/
DOI:
Bibkey:
Cite (ACL):
Ruizhong Miao, Yuying Wang, Rongguang Wang, Chenyang Li, Tao Sheng, Sujith Ravi, and Dan Roth. 2026. GraphER: An Efficient Graph-Based Enrichment and Reranking Method for Retrieval-Augmented Generation. In The Proceedings of Workshop on Document Intelligence and Understanding, pages 100–111, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
GraphER: An Efficient Graph-Based Enrichment and Reranking Method for Retrieval-Augmented Generation (Miao et al., DocInsights 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.docinsights-1.8.pdf