Aggregate While Searching: Online Partial-Trajectory Aggregation for Long-Horizon LLM Search Agents

Feixue Liu, Ruoyu Chen, Songyi Cui, Yimo Yan, Yong-Hong Kuo


Abstract
Parallel test-time scaling treats each rollout as an independent candidate answer. For long-horizon search agents, however, these rollouts also produce rich traces of tool calls, retrieved evidence, and partial reasoning states. Intermediate failures such as reasoning drift are difficult to self-correct within a single rollout, yet useful corrective signals often already exist in other live rollouts before termination. This creates an opportunity to turn cross-trajectory information into online correction during execution, rather than harvesting it only after rollouts terminate. However, simple broadcast is unsafe because partial states can be redundant, irrelevant, or risky for the receiving trajectory. We propose OPTA, a live aggregation framework based on checkpoint-level synchronization: each rollout maintains a private report, while a controller distills a typed global shared state, and injects only relevant and useful feedback into each trajectory, preserving its exploration identity. On BrowseComp-Plus and DeepSearchQA across four LLM backbones, OPTA is consistently the strongest test-time scaling method, lifting Qwen3-30B on BrowseComp-Plus from 37.9% to 59.6%. Our results show that OPTA is a practical route toward timely and selective test-time scaling for long-horizon LLM search agents.
Anthology ID:
2026.emnlp-main.503
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
11555–11570
Language:
URL:
https://aclanthology.org/2026.emnlp-main.503/
DOI:
Bibkey:
Cite (ACL):
Feixue Liu, Ruoyu Chen, Songyi Cui, Yimo Yan, and Yong-Hong Kuo. 2026. Aggregate While Searching: Online Partial-Trajectory Aggregation for Long-Horizon LLM Search Agents. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 11555–11570, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Aggregate While Searching: Online Partial-Trajectory Aggregation for Long-Horizon LLM Search Agents (Liu et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.503.pdf