Jiayi Tian
Author directoryOther people with similar names: Jiayi Tian
2026
MM-BrowseComp: A Comprehensive Benchmark for Multimodal Browsing Agents
Shilong Li | Xingyuan Bu | Wenjie Wang | Jiaheng Liu | Jun Dong | Haoyang He | Hao Lu | Haozhe Zhang | Chenchen Jing | Zhen Li | Chuanhao Li | Jiayi Tian | Chenchen Zhang | Tianhao Peng | Yancheng He | Jihao Gu | Hui Huang | Donghao Zhou | Yuanxing Zhang | Jian Yang | Ge Zhang | Wenhao Huang | Zhaoxiang Zhang | Qiangpeng Yang | Shilei Wen
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Shilong Li | Xingyuan Bu | Wenjie Wang | Jiaheng Liu | Jun Dong | Haoyang He | Hao Lu | Haozhe Zhang | Chenchen Jing | Zhen Li | Chuanhao Li | Jiayi Tian | Chenchen Zhang | Tianhao Peng | Yancheng He | Jihao Gu | Hui Huang | Donghao Zhou | Yuanxing Zhang | Jian Yang | Ge Zhang | Wenhao Huang | Zhaoxiang Zhang | Qiangpeng Yang | Shilei Wen
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
AI agents with advanced reasoning and tool-use capabilities have demonstrated impressive performance in web browsing for deep search. However, existing benchmarks such as BrowseComp primarily focus on textual content, overlooking the prevalence of multimodal content. To bridge this gap, we introduce MM-BrowseComp, a novel benchmark comprising 400 challenging, hand-crafted questions designed to evaluate multimodal retrieval and reasoning capabilities. Unlike prior work, MM-BrowseComp incorporates visual prompts and necessitates the extraction of key evidence from web images and videos to complete questions, rendering text-only approaches insufficient. Additionally, we provide a verified checklist for each question, enabling fine-grained analysis of multimodal dependencies and reasoning paths. Our comprehensive evaluation of 27 state-of-the-art models reveals that even leading models like GPT-5-High with tools achieve only 24.25% accuracy, highlighting the suboptimal multimodal browsing capabilities, establishing MM-BrowseComp as a rigorous new standard for the field.