TSA-RAG: Structure-Preserving Retrieval-Augmented Generation via Tiered Document Graph

Kaiyuan Zhang, Chong Feng, Ge Shi, Lingnan Xu, Bo Wang


Abstract
Retrieval-Augmented Generation (RAG) effectively mitigates hallucinations and knowledge obsolescence in Large Language Models (LLMs). However, prevailing RAG systems typically retrieve evidence from discrete chunks or through decoupled structures, making it difficult to jointly preserve cross-document navigability and within-document coherence on complex tasks. To address this challenge, we propose TSA-RAG (Tiered-Structure-Aware RAG), a unified framework that recasts retrieval as structure-preserving navigation over a Tiered Document Graph (TDG). The TDG offers a joint retrieval space that explicitly couples relational topology with hierarchical skeletons, enabling seamless traversal across granularities. Building on this representation, TSA-RAG navigates evidence through a progressive Expand-Route-Retrieve paradigm, which expands query-focused subgraphs under path-consistency constraints, routes the query to structural entry points within relevant documents, and retrieves subtree-structured evidence preserving discourse continuity. Extensive experiments on seven QA datasets demonstrate that TSA-RAG consistently outperforms strong baselines while yielding more compact retrieval contexts. Quantitative analyses further confirm the scalability and robustness of our framework. Code is available at https://github.com/ZKYQUQ/TSA-RAG.
Anthology ID:
2026.findings-emnlp.754
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
15874–15894
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.754/
DOI:
Bibkey:
Cite (ACL):
Kaiyuan Zhang, Chong Feng, Ge Shi, Lingnan Xu, and Bo Wang. 2026. TSA-RAG: Structure-Preserving Retrieval-Augmented Generation via Tiered Document Graph. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 15874–15894, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
TSA-RAG: Structure-Preserving Retrieval-Augmented Generation via Tiered Document Graph (Zhang et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.754.pdf