Masking Stale Observations Helps Search Agents — Until It Doesn’t: A Regime Map and Its Mechanism

Haoxiang Zhang, Qixin Xu, Zhuofeng Li, Lei Zhang, Pengcheng Jiang, Yu Zhang, Julian McAuley


Abstract
Long-horizon search agents accumulate large amounts of retrieved content across many tool calls, making context-budget efficiency increasingly important. A minimal intervention is to mask stale observations from the context as the trajectory progresses, but it remains unclear when this form of context management helps and why. We study observation masking through a systematic sweep over various agent backbones (4B to 284B parameters) and three retrievers on offline and live-web agentic search benchmarks. We find that the accuracy gain from masking follows an asymmetric inverted-U shape when plotted against the model’s accuracy without context management: a plateau under weak retrievers, a peak in the *mismatch regime* (strong retriever × mid-capacity model), and a sharp collapse when the model is saturated. This pattern reflects the interaction between retriever recall and the model’s implicit filtering capacity, rather than either factor in isolation. Mechanistically, masking implements a token-for-turn trade-off: it removes observations the model has largely stopped attending to and pages the agent rarely re-opens. The added turns help when they convert failures into successes, but they fail when masking removes evidence the model would otherwise have used. We therefore reframe context management as a regime-dependent intervention (rather than a default choice), providing a new, holistic viewpoint that unifies the understanding of agentic deep search.
Anthology ID:
2026.emnlp-main.756
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
17469–17505
Language:
URL:
https://aclanthology.org/2026.emnlp-main.756/
DOI:
Bibkey:
Cite (ACL):
Haoxiang Zhang, Qixin Xu, Zhuofeng Li, Lei Zhang, Pengcheng Jiang, Yu Zhang, and Julian McAuley. 2026. Masking Stale Observations Helps Search Agents — Until It Doesn’t: A Regime Map and Its Mechanism. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 17469–17505, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Masking Stale Observations Helps Search Agents — Until It Doesn’t: A Regime Map and Its Mechanism (Zhang et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.756.pdf