Efficient KG-Augmented RAG with Reusable Graph Community Summaries

Maha Karkout, Maria Andreevna Khodorchenko, Nikolay Alekseevich Butakov, Denis Nasonov


Abstract
Retrieval-augmented generation (RAG) performs well for localized factual queries but struggles with complex questions requiring multi-section evidence integration. Graph-based approaches introduce relational structure, yet their practical integration into QA pipelines involves significant query-time overhead. We present a practical KG-augmented RAG (KG-RAG) design that builds a knowledge graph offline with an LLM, converts graph communities into reusable summaries, and retrieves these summaries jointly with textual evidence at query time. We compare dense RAG, pure GraphRAG, and the proposed hybrid on two benchmarks representing complementary retrieval paradigms: QASPER (intra-document reasoning over scientific papers) and ObliQA (cross-document reasoning over regulatory texts). Results show that pure GraphRAG does not consistently outperform dense retrieval, whereas the hybrid configuration systematically improves relevance, correctness, and completeness while maintaining substantially lower latency than full graph-based inference.
Anthology ID:
2026.kallm-1.12
Volume:
Proceedings of the Knowledge Graphs and Large Language Models Workshop (KG-LLM) @ LREC26
Month:
May
Year:
2026
Address:
Palma, Mallorca (Spain)
Editors:
Gilles Sérasset, Katerina Gkirtzou, Michael Cochez, Jan-Christoph Kalo
Venues:
KaLLM | WS
SIG:
Publisher:
ELRA Language Resources Association (ELRA)
Note:
Pages:
110–119
Language:
External URL:
https://lrec.elra.info/lrec2026-ws-kgllm-12
DOI:
10.63317/5fibrr6chehg
Bibkey:
Cite (ACL):
Maha Karkout, Maria Andreevna Khodorchenko, Nikolay Alekseevich Butakov, and Denis Nasonov. 2026. Efficient KG-Augmented RAG with Reusable Graph Community Summaries. In Proceedings of the Knowledge Graphs and Large Language Models Workshop (KG-LLM) @ LREC26, pages 110–119, Palma, Mallorca (Spain). ELRA Language Resources Association (ELRA).
Cite (Informal):
Efficient KG-Augmented RAG with Reusable Graph Community Summaries (Karkout et al., KaLLM 2026)
Copy Citation: