Adaptive Information Control for Search-Augmented LLM Reasoning

Siheng Xiong, Oguzhan Gungordu, Blair Johnson, James Clayton Kerce, Faramarz Fekri


Abstract
Search-augmented reasoning agents interleave multi-step reasoning with external retrieval, but uncontrolled retrieval can introduce redundant evidence, saturate the context, and destabilize reinforcement learning (RL). Existing outcome-based RL methods provide only sparse terminal rewards, offering limited guidance for intermediate information-acquisition decisions. We propose DeepControl, an adaptive information-control framework based on information utility, a state-dependent estimate of the marginal value of retrieved evidence. The framework regulates information acquisition along two axes: extent, i.e., whether retrieval should continue, and resolution, i.e., how much retrieved detail should be exposed. It implements these controls through retrieval-continuation guidance, hierarchical granularity control, and an annealed control-forcing scheme. This enables the policy to internalize effective acquisition behavior during training and operate without external control at test time. Across seven benchmarks, DeepControl consistently outperforms strong RL and retrieval baselines without explicit information control; compared with Search-R1, it improves average performance by +9.4 and +8.6 points on Qwen2.5-7B and Qwen2.5-3B, respectively. Additional analyses show improved search effectiveness, training stability, and evidence utilization.
Anthology ID:
2026.findings-emnlp.52
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
1036–1078
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.52/
DOI:
Bibkey:
Cite (ACL):
Siheng Xiong, Oguzhan Gungordu, Blair Johnson, James Clayton Kerce, and Faramarz Fekri. 2026. Adaptive Information Control for Search-Augmented LLM Reasoning. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 1036–1078, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Adaptive Information Control for Search-Augmented LLM Reasoning (Xiong et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.52.pdf