DAMG-RAG: Document-Aware Multi-Granularity RAG for Visually Rich Document Understanding

Jiahao Gu, Ningjing Liu, Yuanzhuo Ding, Siheng Chen


Abstract
Real-world documents are visually rich and structurally organized, with text, tables, figures, and captions interleaved across pages. Although retrieval-augmented generation (RAG) is widely used for document question answering, existing pipelines often treat such documents as fixed page- or chunk-level collections. This document-agnostic construction either dilutes evidence in dense pages or fragments semantically related layout elements. Moreover, cross-page questions often require iterative evidence exploration, but existing systems typically follow fixed retrieval paths that do not adapt to the evidence already found.

We propose DAMG-RAG, a Document-Aware Multi-Granularity RAG framework for visually rich document understanding. During ingestion, DAMG-RAG constructs layout-aware atomic retrieval units and links them to page- and section-level nodes, forming a multi-granularity document tree. During inference, a state-aware agentic workflow maintains explored regions and validated evidence, dynamically selecting exploration and navigation tools over this tree. On MMLongBench, DAMG-RAG obtains 64.7% accuracy with Claude Sonnet 4.6, yielding a 3.6-point gain over the best-performing agentic baseline in our experiments while using 18.8% of its token budget.
Anthology ID:
2026.aacl-long.71
Volume:
Proceedings of the 15th International Joint Conference on Natural Language Processing and the 5th Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
November
Year:
2026
Address:
Hengqin, China
Editors:
Yue Zhang, Ruifeng Xu, Ayu Purwarianti, Tong Rong, Jun Suzuki
Venues:
AACL | IJCNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1541–1560
Language:
URL:
https://aclanthology.org/2026.aacl-long.71/
DOI:
Bibkey:
Cite (ACL):
Jiahao Gu, Ningjing Liu, Yuanzhuo Ding, and Siheng Chen. 2026. DAMG-RAG: Document-Aware Multi-Granularity RAG for Visually Rich Document Understanding. In Proceedings of the 15th International Joint Conference on Natural Language Processing and the 5th Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (Volume 1: Long Papers), pages 1541–1560, Hengqin, China. Association for Computational Linguistics.
Cite (Informal):
DAMG-RAG: Document-Aware Multi-Granularity RAG for Visually Rich Document Understanding (Gu et al., AACL-IJCNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.aacl-long.71.pdf