Trip+: Benchmarking Agents in Personalized Interactive Travel Planning

Junle Chen, Wei Chen, Yehong Xu, Zhengjun Huang, Yuqian Wu, Zhoujin Tian, Kai Wang, Rui Chen, Xiaofang Zhou


Abstract
Interactive travel planning has become a popular use case for language models. Agents are deployed to manage evolving preferences and unexpected disruptions over multiple turns. Such settings require models to make complex, profile-conditioned planning decisions. However, existing benchmarks often evaluate feasibility, personalization, or interaction in relatively isolated settings. We therefore introduce Trip+ to measure the ability of agents to plan travel holistically. In Trip+, given traveler profiles and dynamic interactions, agents must generate and revise minute-level itineraries. End-to-end traveler experiences are evaluated via LLM-based simulators, enabling the assessment of subjective metrics like fatigue. Our scenarios range from simple request resolutions to complex environment-driven replanning. We evaluate 18 LMs and find a consistent gap in experiential quality. Models favor technically feasible but exhausting itineraries that show weaker profile alignment.
Anthology ID:
2026.emnlp-main.1384
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
31588–31625
Language:
URL:
https://aclanthology.org/2026.emnlp-main.1384/
DOI:
Bibkey:
Cite (ACL):
Junle Chen, Wei Chen, Yehong Xu, Zhengjun Huang, Yuqian Wu, Zhoujin Tian, Kai Wang, Rui Chen, and Xiaofang Zhou. 2026. Trip+: Benchmarking Agents in Personalized Interactive Travel Planning. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 31588–31625, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Trip+: Benchmarking Agents in Personalized Interactive Travel Planning (Chen et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.1384.pdf