WebTraveler: A Multi-Agent Framework for Continuous Exploration in Website Traversal

Rongchang Li, Yang Shen, Gan Tang, Zizhao Zhang, Shuai Zhang, Haipang WU, Xi Li


Abstract
Large language models (LLMs) are increasingly used as web-facing agents for information-seeking tasks over live websites. Many such tasks require multi-step in-site navigation and cross-page evidence aggregation, a setting known as web traversal. Existing LLM-based web agents, including recent explore–critic architectures, typically store interaction history as an ever-growing unstructured text trace and mix high-level planning with low-level page actions. This makes long-horizon behavior brittle, obscures the source of evidence, and often leads to redundant browsing or premature stopping. To mitigate these issues, we propose WebTraveler, a hierarchical multi-agent framework that separates high-level information-seeking planning from local web exploration and maintains a structured trajectory memory of decision-relevant signals. This design provides compact information interfaces for evidence sufficiency checking and webpage navigation, improving long-horizon stability and cross-page evidence aggregation. To obtain scalable supervision, we further introduce path-guided data synthesis, which uses executable navigation paths to collect trajectories, removes explicit path hints, and filters invalid samples through answer-consistency checks. Experiments show that WebTraveler consistently outperforms previous methods across LLM scales, especially on tasks requiring deeper navigation, with further gains from path-guided supervision. Moreover, WebTraveler also shows generalization to broader web navigation tasks. Code is available at https://github.com/RongchangLi/WebTraveler.
Anthology ID:
2026.emnlp-main.903
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
20800–20820
Language:
URL:
https://aclanthology.org/2026.emnlp-main.903/
DOI:
Bibkey:
Cite (ACL):
Rongchang Li, Yang Shen, Gan Tang, Zizhao Zhang, Shuai Zhang, Haipang WU, and Xi Li. 2026. WebTraveler: A Multi-Agent Framework for Continuous Exploration in Website Traversal. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 20800–20820, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
WebTraveler: A Multi-Agent Framework for Continuous Exploration in Website Traversal (Li et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.903.pdf