DuoPRAG: Rank-Disentangled and Gated Knowledge-Reasoning Fusion

Nakhyeon Choi, Cheoneum Park, Seung-Hoon Na


Abstract
We rethink parametric retrieval-augmented generation with DuoPRAG, which integrates knowledge and reasoning capabilities through rank-disentangled and gated Low-Rank Adaptation (LoRA) composition. Existing parametric RAG methods encode document knowledge into LoRA parameters while leaving reasoning to be supplied through lexical chain-of-thought (CoT) prompting. This introduces three failure modes in outputs and contradicts the prompt-independent inference that parametric RAG aims to achieve. DuoPRAG parameterizes knowledge and reasoning into disentangled LoRA adapters, fused through a learnable mask and rank-specific gates. We achieve state-of-the-art performance on multi-hop QA benchmarks, outperforming the strongest parametric RAG baseline while preserving the parametric inference framework. Our results demonstrate that jointly parameterizing knowledge and reasoning is a natural and effective extension of the parametric RAG paradigm. Our code is available at https://github.com/naknak-choi/DuoPRAG.
Anthology ID:
2026.emnlp-main.413
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
9465–9489
Language:
URL:
https://aclanthology.org/2026.emnlp-main.413/
DOI:
Bibkey:
Cite (ACL):
Nakhyeon Choi, Cheoneum Park, and Seung-Hoon Na. 2026. DuoPRAG: Rank-Disentangled and Gated Knowledge-Reasoning Fusion. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 9465–9489, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
DuoPRAG: Rank-Disentangled and Gated Knowledge-Reasoning Fusion (Choi et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.413.pdf