DeARAG: Decoupled Agentic RAG for On-Device and Precise Multi-Hop Question Answering

Qiuchang Shi, Tianqi Liu, Feng Zhang, Peng Chen, Jianjun Liu, Gaoyun An


Abstract
Although cloud-based Large Language Models (LLMs) have significantly advanced complex multi-hop question answering, they pose severe data privacy risks. On the other hand, simply migrating such compute-intensive systems to edge devices with limited computational resources inevitably triggers context overload and the “lost-in-the-middle” phenomenon. To resolve the privacy-accuracy dilemma, we introduce DeARAG, a fully decoupled, local agentic framework. By shifting heavy hypergraph construction entirely offline, DeARAG substantially condenses the required context during inference. Consequently, the agent’s exploration is strictly grounded in the retrieved hypergraph topology, ensuring rigorous, evidence-based reasoning without overwhelming local resources. Evaluated on multiple datasets, our framework consistently outperforms massive, cloud-dependent baselines (e.g., achieving a gain of 6.47 F1 points on HotpotQA) using only consumer-grade GPUs, enabling highly precise on-device reasoning.
Anthology ID:
2026.emnlp-main.2320
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
52706–52727
Language:
URL:
https://aclanthology.org/2026.emnlp-main.2320/
DOI:
Bibkey:
Cite (ACL):
Qiuchang Shi, Tianqi Liu, Feng Zhang, Peng Chen, Jianjun Liu, and Gaoyun An. 2026. DeARAG: Decoupled Agentic RAG for On-Device and Precise Multi-Hop Question Answering. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 52706–52727, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
DeARAG: Decoupled Agentic RAG for On-Device and Precise Multi-Hop Question Answering (Shi et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.2320.pdf