To Retrieve or To Think? Cross-Boundary Context Evolution for Multi-hop Complex Reasoning

Rubing Chen, Jian Wang, Wenjie Li, Xiao-Yong Wei, Li Qing


Abstract
Current context augmentation methods, such as retrieval-augmented generation, play a crucial role in bridging a model’s internal knowledge boundary and external evidence for multi-hop reasoning. However, they often follow a rigid policy and treat external retrieval as the default action at each step. Such brute-force context expansion incurs unnecessary computational cost and may degrade reasoning performance by saturating the context with redundant or weakly relevant evidence. In this paper, we propose Cross-Boundary Context Evolution (EvoCtx), a framework that models complex reasoning as an adaptive process of boundary-aware context evolution. EvoCtx dynamically decides whether the next reasoning transition should cross the current evidence boundary through retrieval or refine the reasoning state within the existing context. It estimates the semantic gap between the reasoning state and the accumulated evidence, and strategically alternates between boundary expansion and intra-boundary trajectory refinement. This eliminates redundant retrieval steps and preserves a compact, evidence-supported reasoning trajectory. Extensive experiments on challenging open-domain and multi-hop QA benchmarks demonstrate that EvoCtx significantly outperforms previous methods, offering an effective approach to complex tasks. The source code can be accessed at https://github.com/Anya-RB-Chen/EvoCtx.
Anthology ID:
2026.findings-emnlp.2385
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
51247–51259
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.2385/
DOI:
Bibkey:
Cite (ACL):
Rubing Chen, Jian Wang, Wenjie Li, Xiao-Yong Wei, and Li Qing. 2026. To Retrieve or To Think? Cross-Boundary Context Evolution for Multi-hop Complex Reasoning. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 51247–51259, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
To Retrieve or To Think? Cross-Boundary Context Evolution for Multi-hop Complex Reasoning (Chen et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.2385.pdf