Yiming Zhao
Author directoryOther people with similar names: Yiming Zhao
2026
Video-DeepResearch: Towards the Next-Generation Multimodal Deepresearch Agent
Zhen Fang | Yu Zeng | Wenxuan Huang | Yiming Zhao | Shiting Huang | Tianfei Ren | Qi Lu | Qingnan Ren | Qisheng Su | Lionel Z. Wang | Qingyu Yin | Shuang Chen | Zehui Chen | Lin Chen | Zhenfei Yin | Yao Hu | Shaohui Lin | Wanli Ouyang | Shaosheng Cao | Feng Zhao
Findings of the Association for Computational Linguistics: EMNLP 2026
Zhen Fang | Yu Zeng | Wenxuan Huang | Yiming Zhao | Shiting Huang | Tianfei Ren | Qi Lu | Qingnan Ren | Qisheng Su | Lionel Z. Wang | Qingyu Yin | Shuang Chen | Zehui Chen | Lin Chen | Zhenfei Yin | Yao Hu | Shaohui Lin | Wanli Ouyang | Shaosheng Cao | Feng Zhao
Findings of the Association for Computational Linguistics: EMNLP 2026
We introduce Video-DeepResearch (Video-DR), extending multimodal agents from static images to continuous video streams, a setting that demands dense spatiotemporal grounding coupled with open-web exploration. Preliminary evaluations reveal two critical bottlenecks in current models: (1) modality bias, where agents bypass visual tools in favor of textual search, and (2) parametric knowledge leakage, where models rely on internal memory rather than genuine tool-augmented execution. To address these challenges, we propose Video-DeepResearch, featuring a decoupled perception-exploration pipeline with stage-wise tool unlocking that compels exhaustive cross-frame visual grounding prior to web retrieval. Our framework adopts a two-stage training recipe—supervised fine-tuning followed by Group Relative Policy Optimization (GRPO)—enabling autonomous exploration that breaks the imitation-learning ceiling. Furthermore, we curate VideoDR-Bench, a human-AI collaborative benchmark comprising 200 complex, multi-hop VQA instances. Empirical results demonstrate that our Video-DeepResearch-35B-A3B establishes a new state-of-the-art of 64.0% average accuracy, surpassing proprietary Claude-4.5-Sonnet (59.0%) by 5.0 points and significantly outperforming GPT-5 (52.5%) and Gemini 2.5 Pro (57.5%). The 30B-A3B variant achieves 59.3%, competitive with Claude-4.5-Sonnet and demonstrating the effectiveness of our training paradigm even at compact scale.
2025
Enhancing Large Vision-Language Models with Ultra-Detailed Image Caption Generation
Yu Zeng | Yukun Qi | Yiming Zhao | Xikun Bao | Lin Chen | Zehui Chen | Shiting Huang | Jie Zhao | Feng Zhao
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Yu Zeng | Yukun Qi | Yiming Zhao | Xikun Bao | Lin Chen | Zehui Chen | Shiting Huang | Jie Zhao | Feng Zhao
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
High-quality image captions are essential for improving modality alignment and visual understanding in Large Vision-Language Models (LVLMs). However, the scarcity of ultra-detailed image caption data limits further advancements. This paper presents a systematic pipeline for generating high-quality, ultra-detailed image captions, encompassing both pre-processing and post-processing stages. In the pre-processing stage, we classify and deduplicate images, extract visual information using expert tools, and leverage GPT-4o with structured prompts to generate initial captions. To enhance comprehensiveness, we introduce an expansion strategy based on Large Language Models (LLMs), defining eight descriptive dimensions to refine and extend captions, which serve as seed data for training a proprietary captioner model. In the post-processing stage, we incorporate human error-correction annotations and an active learning-inspired approach to refine low-quality samples. Using high-quality corrected data, we apply Direct Preference Optimization (DPO) and develop a critic-rewrite pipeline, training a sentence-level critic model to mitigate hallucinations. Experimental results demonstrate that our ultra-detailed captions significantly enhance LVLMs’ perception and cognitive abilities across multiple vision-language benchmarks. The code and dataset are available at https://github.com/yuzeng0-0/UltraCaption.