Learning When to Think: Utility-Guided Adaptive Reasoning for Efficient Text Retrieval

Yingtao Luo, Kangyi Zhao, Shiyi Du, Yubo Li


Abstract
Reasoning-conditioned embeddings can improve retrieval by progressively refining semantic constraints. However, additional reasoning may introduce over-generalized or semantically noisy abstractions that weaken retrieval specificity. Existing methods largely supervise reasoning through final retrieval outcomes, providing limited guidance over the refinement process itself. We propose AURA, a framework that directly supervises intermediate reasoning states according to how well they separate relevant documents from hard distractors. AURA further trains a lightweight utility estimator over prefix-conditioned embeddings to adapt reasoning depth at inference time. On the reasoning-intensive BRIGHT benchmark, AURA-4B achieves 34.7 average nDCG@10 while using 2.8 reasoning steps and 96 generated tokens per query. Under matched deployment conditions, adaptive stopping reduces latency from 4.6 to 0.76 seconds relative to full-trajectory reasoning. Results on MS MARCO further suggest that this specialization need not substantially degrade conventional in-domain retrieval.
Anthology ID:
2026.findings-emnlp.1617
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
34424–34434
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.1617/
DOI:
Bibkey:
Cite (ACL):
Yingtao Luo, Kangyi Zhao, Shiyi Du, and Yubo Li. 2026. Learning When to Think: Utility-Guided Adaptive Reasoning for Efficient Text Retrieval. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 34424–34434, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Learning When to Think: Utility-Guided Adaptive Reasoning for Efficient Text Retrieval (Luo et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.1617.pdf