Yue Fan
Author directoryPapers on this page may belong to the following people: Yue Fan, Yue Fan
2026
DualResearch: Entropy-Gated Dual-Graph Retrieval for Answer Reconstruction in Deep Research Agents
Jinxin Shi | Zongsheng Cao | Runmin Ma | Yusong Hu | Jie Zhou | Yue Fan | Xin Li | Lei Bai | Liang He | Bo Zhang
Findings of the Association for Computational Linguistics: EMNLP 2026
Jinxin Shi | Zongsheng Cao | Runmin Ma | Yusong Hu | Jie Zhou | Yue Fan | Xin Li | Lei Bai | Liang He | Bo Zhang
Findings of the Association for Computational Linguistics: EMNLP 2026
Deep Research Agents (DR-Agents) extend LLMs with multi-step retrieval, tool use, and intermediate computation to solve complex problems. However, their execution logs often contain redundant context, noisy evidence, and brittle dependencies among intermediate decisions. As a result, final answers can be sensitive to irrelevant or weakly verified information. We propose DualResearch, a log-based post-processing framework for answer reconstruction. Given a query and a completed DR-Agent log, DualResearch normalizes the log into event records and constructs two evidence graphs: a breadth semantic graph for declarative evidence and a depth causal graph for procedural provenance. It then retrieves breadth nodes and depth paths, assigns higher weights to retrieval channels with more concentrated retained candidate distributions, and jointly considers relevance and cross-view agreement to select evidence for reconstruction; the concentration measure reflects retrieval confidence rather than factual correctness. Experiments on HLE, GAIA, and GPQA show consistent accuracy improvements over underlying DR-Agents and controlled log-reuse baselines.
Proceedings of the 4th Workshop on Advances in Language and Vision Research (ALVR)
Qianqi Yan | Syrielle Montariol | Yue Fan | Jing Gu | Jiayi Pan | Manling Li | Parisa Kordjamshidi | Alane Suhr | Xin Eric Wang
Proceedings of the 4th Workshop on Advances in Language and Vision Research (ALVR)
Qianqi Yan | Syrielle Montariol | Yue Fan | Jing Gu | Jiayi Pan | Manling Li | Parisa Kordjamshidi | Alane Suhr | Xin Eric Wang
Proceedings of the 4th Workshop on Advances in Language and Vision Research (ALVR)
FlowSearch: Advancing Deep Research with Dynamic Structured Knowledge Flow
Yusong Hu | Runmin Ma | Yue Fan | Jinxin Shi | Zongsheng Cao | Yuhao Zhou | Jiakang Yuan | Shuaiyu Zhang | Shiyang Feng | Xiangchao Yan | Shufei Zhang | Wenlong Zhang | Lei Bai | Bo Zhang
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Yusong Hu | Runmin Ma | Yue Fan | Jinxin Shi | Zongsheng Cao | Yuhao Zhou | Jiakang Yuan | Shuaiyu Zhang | Shiyang Feng | Xiangchao Yan | Shufei Zhang | Wenlong Zhang | Lei Bai | Bo Zhang
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Deep research is an inherently challenging task that demands both breadth and depth of thinking. It involves navigating diverse knowledge spaces and reasoning over complex, multi-step dependencies, which presents substantial challenges for agentic systems. To address this, we propose FlowSearch, a multi-agent framework that actively constructs and evolves a dynamic structured knowledge flow to drive subtask execution and reasoning. FlowSearch is capable of strategically planning and expanding the knowledge flow to enable parallel exploration and hierarchical task decomposition, while also adjusting the knowledge flow in real time based on feedback from intermediate reasoning outcomes and insights. FlowSearch achieves competitive performance on both general and scientific benchmarks, including GAIA, HLE, GPQA and TRQA, demonstrating its effectiveness in multi-disciplinary research scenarios and its potential to advance scientific discovery. The code will be available.
2025
Multimodal Language Models See Better When They Look Shallower
Haoran Chen | Junyan Lin | Xinghao Chen | Yue Fan | Jianfeng Dong | Xin Jin | Hui Su | Jinlan Fu | Xiaoyu Shen
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Haoran Chen | Junyan Lin | Xinghao Chen | Yue Fan | Jianfeng Dong | Xin Jin | Hui Su | Jinlan Fu | Xiaoyu Shen
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Multimodal large language models (MLLMs) typically extract visual features from the final layers of a pretrained Vision Transformer (ViT). This widespread deep-layer bias, however, is largely driven by empirical convention rather than principled analysis. While prior studies suggest that different ViT layers capture different types of information—shallower layers focusing on fine visual details and deeper layers aligning more closely with textual semantics, the impact of this variation on MLLM performance remains underexplored. We present the first comprehensive study of visual layer selection for MLLMs, analyzing representation similarity across ViT layers to establish shallow, middle, and deep layer groupings. Through extensive evaluation of MLLMs (1.4B–7B parameters) across 10 benchmarks encompassing 60+ tasks, we find that while deep layers excel in semantic-rich tasks like OCR, shallow and middle layers significantly outperform them on fine-grained visual tasks including counting, positioning, and object localization. Building on these insights, we propose a lightweight feature fusion method that strategically incorporates shallower layers, achieving consistent improvements over both single-layer and specialized fusion baselines. Our work offers the first principled study of visual layer selection in MLLMs, showing that MLLMs can often see better when they look shallower.
2024
Muffin or Chihuahua? Challenging Multimodal Large Language Models with Multipanel VQA
Yue Fan | Jing Gu | Kaiwen Zhou | Qianqi Yan | Shan Jiang | Ching-Chen Kuo | Yang Zhao | Xinze Guan | Xin Wang
Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Yue Fan | Jing Gu | Kaiwen Zhou | Qianqi Yan | Shan Jiang | Ching-Chen Kuo | Yang Zhao | Xinze Guan | Xin Wang
Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Multipanel images, commonly seen as web screenshots, posters, etc., pervade our daily lives. These images, characterized by their composition of multiple subfigures in distinct layouts, effectively convey information to people. Toward building advanced multimodal AI applications, such as agents that understand complex scenes and navigate through webpages, the skill of multipanel visual reasoning is essential, and a comprehensive evaluation of models in this regard is important. Therefore, we introduce Multipanel Visual Question Answering (MultipanelVQA), a novel benchmark comprising 6,600 triplets of questions, answers, and multipanel images that specifically challenge models in comprehending multipanel images. Our evaluation shows that questions in the MultipanelVQA benchmark pose significant challenges to the state-of-the-art Multimodal Large Language Models (MLLMs) tested, even though humans can attain approximately 99% accuracy on these questions. Distinctively, the MultipanelVQA benchmark features synthetically generated multipanel images specifically crafted to isolate and assess the impact of various factors, such as the layout, on MLLMs’ multipanel image comprehension abilities. As a result, in addition to benchmarking the capabilities of MLLMs in understanding multipanel images, we analyze various factors of the multipanel image that affect MLLMs’ performance with synthetic data and offer insights for enhancement.
2023
Proceedings of the 3rd Combined Workshop on Spatial Language Understanding and Grounded Communication for Robotics (SpLU-RoboNLP 2023)
Aishwarya Padmakumar | Mert Inan | Yue Fan | Xin Wang | Malihe Alikhani
Proceedings of the 3rd Combined Workshop on Spatial Language Understanding and Grounded Communication for Robotics (SpLU-RoboNLP 2023)
Aishwarya Padmakumar | Mert Inan | Yue Fan | Xin Wang | Malihe Alikhani
Proceedings of the 3rd Combined Workshop on Spatial Language Understanding and Grounded Communication for Robotics (SpLU-RoboNLP 2023)
Aerial Vision-and-Dialog Navigation
Yue Fan | Winson Chen | Tongzhou Jiang | Chun Zhou | Yi Zhang | Xin Wang
Findings of the Association for Computational Linguistics: ACL 2023
Yue Fan | Winson Chen | Tongzhou Jiang | Chun Zhou | Yi Zhang | Xin Wang
Findings of the Association for Computational Linguistics: ACL 2023
The ability to converse with humans and follow natural language commands is crucial for intelligent unmanned aerial vehicles (a.k.a. drones). It can relieve people’s burden of holding a controller all the time, allow multitasking, and make drone control more accessible for people with disabilities or with their hands occupied. To this end, we introduce Aerial Vision-and-Dialog Navigation (AVDN), to navigate a drone via natural language conversation. We build a drone simulator with a continuous photorealistic environment and collect a new AVDN dataset of over 3k recorded navigation trajectories with asynchronous human-human dialogs between commanders and followers. The commander provides initial navigation instruction and further guidance by request, while the follower navigates the drone in the simulator and asks questions when needed. During data collection, followers’ attention on the drone’s visual observation is also recorded. Based on the AVDN dataset, we study the tasks of aerial navigation from (full) dialog history and propose an effective Human Attention Aided Transformer model (HAA-Transformer), which learns to predict both navigation waypoints and human attention.
R2H: Building Multimodal Navigation Helpers that Respond to Help Requests
Yue Fan | Jing Gu | Kaizhi Zheng | Xin Wang
Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing
Yue Fan | Jing Gu | Kaizhi Zheng | Xin Wang
Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing
Intelligent navigation-helper agents are critical as they can navigate users in unknown areas through environmental awareness and conversational ability, serving as potential accessibility tools for individuals with disabilities. In this work, we first introduce a novel benchmark, Respond to Help Requests (R2H), to promote the development of multi-modal navigation helpers capable of responding to requests for help, utilizing existing dialog-based embodied datasets. R2H mainly includes two tasks: (1) Respond to Dialog History (RDH), which assesses the helper agent’s ability to generate informative responses based on a given dialog history, and (2) Respond during Interaction (RdI), which evaluates the effectiveness and efficiency of the response during consistent cooperation with a task performer. Furthermore, we explore two approaches to construct the navigation-helper agent, including fine-tuning a novel task-oriented multi-modal response generation model that can see and respond, named SeeRee, and employing a multi-modal large language model in a zero-shot manner. Analysis of the task and method was conducted based on both automatic benchmarking and human evaluations.
Search
Fix author
Co-authors
- Xin Wang 4
- Jing Gu 3
- Lei Bai 2
- Zongsheng Cao 2
- Yusong Hu 2
- Runmin Ma 2
- Jinxin Shi 2
- Qianqi Yan 2
- Bo Zhang 2
- Malihe Alikhani 1
- Haoran Chen 1
- Winson Chen 1
- Xinghao Chen 1
- Jianfeng Dong 1
- Shiyang Feng 1
- Jinlan Fu 1
- Xinze Guan 1
- Liang He 1
- Mert Inan 1
- Shan Jiang 1
- Tongzhou Jiang 1
- Xin Jin 1
- Parisa Kordjamshidi 1
- Ching-Chen Kuo 1
- Manling Li 1
- Xin Li 1
- Junyan Lin 1
- Syrielle Montariol 1
- Aishwarya Padmakumar 1
- Jiayi Pan 1
- Xiaoyu Shen 1
- Hui Su 1
- Alane Suhr 1
- Xin Eric Wang 1
- Xiangchao Yan 1
- Jiakang Yuan 1
- Shuaiyu Zhang 1
- Shufei Zhang 1
- Wenlong Zhang 1
- Yi Zhang 1
- Yang Zhao 1
- Kaizhi Zheng 1
- Chun Zhou 1
- Jie Zhou 1
- Kaiwen Zhou 1
- Yuhao Zhou 1