RASER: Recoverability-Aware Selective Escalation Router for Multi-Hop Question Answering

Yuyang Li, Zihe Yan, Tobias Käfer


Abstract
Multi-hop question-answering systems often use expensive retrieval on every question. They may decompose the question, run several retrieval rounds, or search through bridge entities before answering. All of these strategies rely on repeated LLM calls to rewrite or decompose the question, which increases extra token cost, and it is not fitting when the LLM budget is tight. However, our analysis shows that lots of multi-hop questions are already answered correctly by a single one-shot RAG, so running an extra retrieval on every question wastes the budget. We introduce RASER (Recoverability-Aware Selective Escalation Router), a family of cheap routers built on one-shot RAG and six features from it. RASER-2 decides whether to stop or escalate to the extra-retrieval action PRUNE. RASER-3 chooses among one-shot RAG, PRUNE, and iterative retrieval IRCoT, using the same features but adding an explicit cost-accuracy trade-off. Neither router makes an extra LLM call to decide. Across six LLMs and three multi-hop QA benchmarks, both routers stay competitive with the other state-of-the-art (SOTA) baselines in F1 while spending only 41–49% of always-prune’s tokens and also less than the iterative and decomposition retrieval baselines.
Anthology ID:
2026.findings-aacl.219
Volume:
Findings of the Association for Computational Linguistics: IJCNLP-AACL 2026
Month:
November
Year:
2026
Address:
Hengqin, China
Editors:
Yue Zhang, Ruifeng Xu, Ayu Purwarianti, Tong Rong, Jun Suzuki
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
4295–4311
Language:
URL:
https://aclanthology.org/2026.findings-aacl.219/
DOI:
Bibkey:
Cite (ACL):
Yuyang Li, Zihe Yan, and Tobias Käfer. 2026. RASER: Recoverability-Aware Selective Escalation Router for Multi-Hop Question Answering. In Findings of the Association for Computational Linguistics: IJCNLP-AACL 2026, pages 4295–4311, Hengqin, China. Association for Computational Linguistics.
Cite (Informal):
RASER: Recoverability-Aware Selective Escalation Router for Multi-Hop Question Answering (Li et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-aacl.219.pdf