Qianqian Xie
Author directoryOther people with similar names: Qianqian Xie
Unverified author pages with similar names: Qianqian Xie
2026
MT-Video-Bench: A Holistic Video Understanding Benchmark for Evaluating Multimodal LLMs in Multi-Turn Dialogues
Yaning Pan | Qianqian Xie | Guohui Zhang | Zekun Moore Wang | Yongqian Wen | Yuanxing Zhang | Haoxuan Hu | Zhiyu Pan | Yibing Huang | Zhidong Gan | Yonghong Lin | An Ping | Shihao Li | Yanghai Wang | Tianhao Peng | Jiaheng Liu
Findings of the Association for Computational Linguistics: ACL 2026
Yaning Pan | Qianqian Xie | Guohui Zhang | Zekun Moore Wang | Yongqian Wen | Yuanxing Zhang | Haoxuan Hu | Zhiyu Pan | Yibing Huang | Zhidong Gan | Yonghong Lin | An Ping | Shihao Li | Yanghai Wang | Tianhao Peng | Jiaheng Liu
Findings of the Association for Computational Linguistics: ACL 2026
The recent development of Multimodal Large Language Models (MLLMs) has significantly advanced AI’s ability to understand visual modalities. However, existing evaluation benchmarks remain limited to single-turn question answering, overlooking the complexity of multi-turn dialogues in real-world scenarios. To bridge this gap, we introduce MT-Video-Bench, a holistic video understanding benchmark for evaluating MLLMs in multi-turn dialogues. Specifically, our MT-Video-Bench mainly assesses six core competencies that focus on perceptivity and interactivity, encompassing 1,000 meticulously curated multi-turn dialogues from diverse domains. These capabilities are rigorously aligned with real-world applications, such as interactive sports analysis and multi-turn video-based intelligent tutoring. With MT-Video-Bench, we extensively evaluate various state-of-the-art open-source and closed-source MLLMs, revealing their significant performance discrepancies and limitations in handling multi-turn video dialogues. The benchmark will be publicly available to foster future research.
DR3-Eval: Towards Realistic and Reproducible Deep Research Evaluation
Qianqian Xie | He Zhu | Xueming Han | Qingheng Xiong | Tiantian Xia | Fanyu Meng | Jiakai Wang | Zhiqi Bai | Chengkang Jiang | Zhaohui Wang | Yubin Guo | Yuqing Wen | Jiayang Mao | Zijie Zhang | Shihao Li | Yanghai Wang | Yuxiang Ren | Junlan Feng | Jiaheng Liu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Qianqian Xie | He Zhu | Xueming Han | Qingheng Xiong | Tiantian Xia | Fanyu Meng | Jiakai Wang | Zhiqi Bai | Chengkang Jiang | Zhaohui Wang | Yubin Guo | Yuqing Wen | Jiayang Mao | Zijie Zhang | Shihao Li | Yanghai Wang | Yuxiang Ren | Junlan Feng | Jiaheng Liu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Deep Research Agents (DRAs) aim to solve complex, long-horizon research tasks involving planning, retrieval, multimodal understanding, and report generation, yet their evaluation remains challenging due to dynamic web environments and ambiguous task definitions. We propose **DR3-Eval**, a realistic and reproducible benchmark for evaluating deep research agents on multimodal, multi-file report generation. DR3-Eval is constructed from authentic user-provided materials and paired with a per-task static research sandbox corpus that simulates open-web complexity while remaining fully verifiable, containing supportive documents, distractors, and noise. Moreover, we introduce a multi-dimensional evaluation framework measuring Information Recall, Factual Accuracy, Citation Coverage, Instruction Following, and Depth Quality, and validate its alignment with human judgments. Experiments with our developed multi-agent system DR3-Agent based on multiple state-of-the-art language models demonstrate that DR3-Eval is highly challenging and reveals critical failure modes in retrieval robustness and hallucination control.
TVIR: Building Deep Research Agents Towards Text-Visual Interleaved Report Generation
Xinkai Ma | Zhiqi Bai | Dingling Zhang | Pei Liu | Yishuo Yuan | He Zhu | Jiakai Wang | Qianqian Xie | Yifan Zhao | Xinlong Yang | Hao Cong | Zhiheng Yao | Fengxia Xie | Zihao Xu | Haoran Xu | Zhaohui Wang | Minghao Liu | Shirong Lin | Yingshui Tan | Yuchi Xu | Wenbo Su | Zhaoxiang Zhang | Bo Zheng | Jiaheng Liu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Xinkai Ma | Zhiqi Bai | Dingling Zhang | Pei Liu | Yishuo Yuan | He Zhu | Jiakai Wang | Qianqian Xie | Yifan Zhao | Xinlong Yang | Hao Cong | Zhiheng Yao | Fengxia Xie | Zihao Xu | Haoran Xu | Zhaohui Wang | Minghao Liu | Shirong Lin | Yingshui Tan | Yuchi Xu | Wenbo Su | Zhaoxiang Zhang | Bo Zheng | Jiaheng Liu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Deep Research Agents have shown strong capability in multi-step information retrieval, reasoning, and long-form report generation, but existing benchmarks and systems remain predominantly text-centric, with limited evaluation of whether visual elements are factually reliable and well aligned with the surrounding analysis. To address this gap, we introduce TVIR (Text–Visual Interleaved Report Generation), which includes TVIR-Bench, a benchmark of 100 expert-curated multimodal deep research tasks that require visual elements to serve specific analytical sub-goals, and TVIR-Agent, a hierarchical multi-agent framework for constructing structured outlines, retrieving images, generating charts with traceable sources, and composing reports through context-aware sequential writing. We further develop a dual-path evaluation framework that combines Textual Assessment and Visual Assessment. Experiments across nine deep research systems show that TVIR-Agent achieves strong overall performance, underscoring the importance of explicit multimodal design and evaluation for evidence-driven report generation.
Search
Fix author
Co-authors
- Jiaheng Liu 3
- Zhiqi Bai 2
- Shihao Li 2
- Jiakai Wang 2
- Yanghai Wang 2
- Zhaohui Wang 2
- He Zhu 2
- Hao Cong 1
- Junlan Feng 1
- Zhidong Gan 1
- Yubin Guo 1
- Xueming Han 1
- Haoxuan Hu 1
- Yibing Huang 1
- Chengkang Jiang 1
- Shirong Lin 1
- Yonghong Lin 1
- Minghao Liu 1
- Pei Liu 1
- Xinkai Ma 1
- Jiayang Mao 1
- Fanyu Meng 1
- Yaning Pan 1
- Zhiyu Pan 1
- Tianhao Peng 1
- An Ping 1
- Yuxiang Ren 1
- Wenbo Su 1
- Yingshui Tan 1
- Zekun Moore Wang 1
- Yongqian Wen 1
- Yuqing Wen 1
- Tiantian Xia 1
- Fengxia Xie 1
- Qingheng Xiong 1
- Haoran Xu 1
- Yuchi Xu 1
- Zihao Xu 1
- Xinlong Yang 1
- Zhiheng Yao 1
- Yishuo Yuan 1
- Dingling Zhang 1
- Guohui Zhang 1
- Yuanxing Zhang 1
- Zhaoxiang Zhang 1
- Zijie Zhang 1
- Yifan Zhao 1
- Bo Zheng 1