Beyond Static Retrieval: Opportunities and Pitfalls of Iterative Retrieval in GraphRAG

Kai Guo, Xinnan Dai, Shenglai Zeng, Harry Shomer, Haoyu Han, Yu Wang, Hui Liu


Abstract
Graph-based RAG (GraphRAG) leverages entity–relation graphs to support multi-hop reasoning, but most systems still rely on static retrieval. When crucial evidence, especially bridge documents that connect disjoint entities, is absent, reasoning collapses and hallucinations persist. Iterative retrieval, which performs multiple rounds of evidence selection, has emerged as a promising alternative, yet its role within GraphRAG remains poorly understood. We present the first systematic study of iterative retrieval in GraphRAG by analyzing how different strategies interact with graph-based backbones and investigating when they are effective. Our findings reveal both opportunities and pitfalls which together highlight a central bottleneck, namely that GraphRAG’s effectiveness depends not only on recall but also on whether bridge evidence is consistently promoted into leading positions where it can support reasoning chains. To address this limitation, we propose Bridge-Guided Dual-Thought-based Retrieval (BDTR), a simple yet effective framework that generates complementary thoughts and leverages reasoning chains to recalibrate rankings and bring bridge evidence into leading positions. BDTR achieves consistent improvements across diverse GraphRAG settings and provides guidance for the design of future GraphRAG systems. Our code is available at https://github.com/KaiGuo20/BDTR.
Anthology ID:
2026.emnlp-main.1897
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
43249–43271
Language:
URL:
https://aclanthology.org/2026.emnlp-main.1897/
DOI:
Bibkey:
Cite (ACL):
Kai Guo, Xinnan Dai, Shenglai Zeng, Harry Shomer, Haoyu Han, Yu Wang, and Hui Liu. 2026. Beyond Static Retrieval: Opportunities and Pitfalls of Iterative Retrieval in GraphRAG. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 43249–43271, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Beyond Static Retrieval: Opportunities and Pitfalls of Iterative Retrieval in GraphRAG (Guo et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.1897.pdf