Tao Yu
Author directoryOther people with similar names: Tao Yu
Unverified author pages with similar names: Tao Yu
2026
When Seeing Is Not Believing—A Benchmark for Search-Grounded Video Misinformation Detection
Tao Yu | Yujia Yang | Shenghua Chai | Jinshuai Zhang | Haopeng Jin | Hao Wang | Minghui Zhang | Zhongtian Luo | Yuchen Long | Xinlong Chen | Jiabing Yang | Zhaolu Kang | Yuxuan Zhou | Siyi Cao | Yuqing Wu | Peifan Wang | Tianyang Dang | Minghui Guo | Hanyu Wang | Hai Huang | Zhengyu Man | Xingyu Yang | Xinya Sun | Xinming Wang | Hongzhu Yi | Zheqi He | Xi Yang | Yan Huang | Liang Wang
Findings of the Association for Computational Linguistics: EMNLP 2026
Tao Yu | Yujia Yang | Shenghua Chai | Jinshuai Zhang | Haopeng Jin | Hao Wang | Minghui Zhang | Zhongtian Luo | Yuchen Long | Xinlong Chen | Jiabing Yang | Zhaolu Kang | Yuxuan Zhou | Siyi Cao | Yuqing Wu | Peifan Wang | Tianyang Dang | Minghui Guo | Hanyu Wang | Hai Huang | Zhengyu Man | Xingyu Yang | Xinya Sun | Xinming Wang | Hongzhu Yi | Zheqi He | Xi Yang | Yan Huang | Liang Wang
Findings of the Association for Computational Linguistics: EMNLP 2026
Video misinformation increasingly operates at the semantic and evidential level: authentic footage may be selectively edited, temporally reordered, spliced across sources, or augmented with AI-generated content to construct false narratives. Such evidence-dependent manipulations cannot be reliably verified from the input video alone, because the missing, reordered, replaced, or recontextualized evidence lies outside the video itself. We introduce EVID-Bench, a benchmark for search-grounded video misinformation detection, where a system must search the open web for related videos and identify what information is false through cross-video comparison. EVID-Bench comprises 222 videos spanning 9 manipulation types across 3 categories: AI generation, single-source editing, and multi-source editing. All samples are verified to be undetectable by frontier models through visual inspection alone. We evaluate nine frontier multimodal models using a retrieval-augmented verification baseline. The best system achieves only 61.43% point-level accuracy and 43.24% video-level accuracy, with AI-generated manipulations remaining especially difficult. Error analysis reveals recurring challenges: models fixate on irrelevant anchors, misattribute synthetic content to editorial splicing, and terminate search prematurely before fully explaining the manipulation.
ShotFinder: Imagination-Driven Open-Domain Video Shot Retrieval via Web Search
Tao Yu | Haopeng Jin | Hao Wang | Shenghua Chai | Yujia Yang | Zhongtian Luo | Junhao Gong | Jiaming Guo | Minghui Zhang | Xinlong Chen | Zhenghao Zhang | Yuxuan Zhou | Yanpei Gong | YuanCheng Liu | Yiming Ding | Kangwei Zeng | Pengfei Yang | Yufei Xiong | Shanbin Zhang | Chengshaoxiong | Huang Ruilin | Li Shuo | Yuxi Niu | Xinyuan Zhang | Yueya Xu | Jie Mao | Ruixuan Ji | Yaru Zhao | Mingchen Zhang | Jiabing Yang | Jiaqi Liu | YiFan Zhang | Hongzhu Yi | Xinming Wang | Cheng Zhong | Xiao Ma | Zhang Zhang | Yan Huang | Liang Wang
Findings of the Association for Computational Linguistics: EMNLP 2026
Tao Yu | Haopeng Jin | Hao Wang | Shenghua Chai | Yujia Yang | Zhongtian Luo | Junhao Gong | Jiaming Guo | Minghui Zhang | Xinlong Chen | Zhenghao Zhang | Yuxuan Zhou | Yanpei Gong | YuanCheng Liu | Yiming Ding | Kangwei Zeng | Pengfei Yang | Yufei Xiong | Shanbin Zhang | Chengshaoxiong | Huang Ruilin | Li Shuo | Yuxi Niu | Xinyuan Zhang | Yueya Xu | Jie Mao | Ruixuan Ji | Yaru Zhao | Mingchen Zhang | Jiabing Yang | Jiaqi Liu | YiFan Zhang | Hongzhu Yi | Xinming Wang | Cheng Zhong | Xiao Ma | Zhang Zhang | Yan Huang | Liang Wang
Findings of the Association for Computational Linguistics: EMNLP 2026
In recent years, large language models (LLMs) have made rapid progress in information retrieval, yet existing research has mainly focused on text or static multimodal settings. Open-domain video shot retrieval, which involves richer temporal structure and more complex semantics, still lacks systematic benchmarks and analysis. To fill this gap, we introduce ShotFinder, a benchmark that formalizes editing requirements as keyframe-oriented shot descriptions and introduces five types of controllable single-factor constraints: Temporal order, Color, Visual style, Audio, and Resolution. We curate 1,210 high-quality samples from YouTube across 20 thematic categories, using large models for generation with human verification. Based on the benchmark, we propose ShotFinder, a text-driven three-stage retrieval and localization pipeline: (1) query expansion via video imagination, (2) candidate video retrieval with a search engine, and (3) description-guided shot localization. Experiments on multiple closed-source and open-source models reveal a significant gap to human performance, with clear imbalance across constraints: temporal localization is relatively tractable, while color and visual style remain major challenges. These results reveal that open-domain video shot retrieval is still a critical capability that multimodal large models have yet to overcome.
Why does Weak-OOD Help? A Further Step Towards Understanding Jailbreaking VLMs
Yuxuan Zhou | Yuzhao Peng | Yang Bai | Kuofeng Gao | Yihao Zhang | Yechao Zhang | Xun Chen | Tao Yu | Tao Dai | Shu-Tao Xia
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Yuxuan Zhou | Yuzhao Peng | Yang Bai | Kuofeng Gao | Yihao Zhang | Yechao Zhang | Xun Chen | Tao Yu | Tao Dai | Shu-Tao Xia
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Large Vision-Language Models (VLMs) are susceptible to jailbreak attacks: researchers have developed various attack strategies that bypass the safety mechanisms of VLMs. Among these approaches, jailbreak methods based on the Out-of-Distribution (OOD) strategy have garnered widespread attention due to their simplicity and effectiveness. This paper further advances the understanding of OOD-based VLM jailbreak methods. We show that mild OOD manipulations can achieve stronger jailbreak performance than both clean inputs and overly strong perturbations, a non-monotonic pattern we define as "weak-OOD". We explain this phenomenon through a trade-off between two dominant factors: input intent perception and model refusal triggering. Our evidence suggests that these two factors respond differently to OOD manipulations, which is consistent with a discrepancy between broad pre-training robustness and narrower safety alignment. Building on this insight, we draw inspiration from optical character recognition (OCR) capability enhancement, a core task in the pre-training phase of mainstream VLMs. Leveraging this capability, we design JOCR (Jailbreak via OCR-Aware Embedded Text Perturbation), a simple VLM jailbreak method that achieves the best average ASR among evaluated baselines.
Scaling Law for Multimodal Large Language Model Supervised Fine-Tuning
YiFan Zhang | Tao Yu | Feng Li | Chaoyou Fu | Yibo Hu | Kun Wang | Qingsong Wen | Zhang Zhang | Liang Wang | Rong Jin
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
YiFan Zhang | Tao Yu | Feng Li | Chaoyou Fu | Yibo Hu | Kun Wang | Qingsong Wen | Zhang Zhang | Liang Wang | Rong Jin
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
The supervised fine-tuning (SFT) stage is crucial for multimodal large language models (MLLMs), yet a comprehensive scaling law to guide the optimal model-data configuration remains lacking. In this paper, we make an initial attempt to address this gap. First, we theoretically demonstrate that directly computing the optimal computation frontier for MLLM-SFT, as we can for traditional LLMs, is a challenging task. This complexity arises because MLLM-SFT is influenced by a broader range of factors, including model size, LLM pre-training tokens, and MLLM SFT tokens. To tackle this issue, we propose two scaling laws based on LLM paradigms: one applicable when training data volumes are well defined by researchers, and another for cases where models are sourced from open communities with unknown training data. Through theoretical modeling and approximations, we provide researchers with valuable recommendations for optimal resource allocation. Furthermore, we establish a strong correlation ( R2 = 0.98) between training loss and downstream performance, enabling accurate performance estimation without the need for exhaustive benchmarking. To validate our scaling laws, we construct a testbed of 60 models ranging from 50 million to 8 billion parameters, totaling 1,560 checkpoints. Each checkpoint is evaluated on than 10 MLLM benchmarks, ensuring robust fitting of our formulations.
Search
Fix author
Co-authors
- Liang Wang 3
- Yuxuan Zhou 3
- Shenghua Chai 2
- Xinlong Chen 2
- Yan Huang 2
- Haopeng Jin 2
- Zhongtian Luo 2
- Xinming Wang 2
- Jiabing Yang 2
- Yujia Yang 2
- Hongzhu Yi 2
- Minghui Zhang 2
- YiFan Zhang 2
- Zhang Zhang 2
- Yang Bai 1
- Siyi Cao 1
- Xun Chen 1
- Chengshaoxiong 1
- Tao Dai 1
- Tianyang Dang 1
- Yiming Ding 1
- Chaoyou Fu 1
- Kuofeng Gao 1
- Junhao Gong 1
- Yanpei Gong 1
- Jiaming Guo 1
- Minghui Guo 1
- Zheqi He 1
- Yibo Hu 1
- Hai Huang 1
- Ruixuan Ji 1
- Rong Jin 1
- Zhang Jinshuai 1
- Zhaolu Kang 1
- Feng Li 1
- Jiaqi Liu 1
- YuanCheng Liu 1
- Yuchen Long 1
- Xiao Ma 1
- Zhengyu Man 1
- Jie Mao 1
- Yuxi Niu 1
- Yuzhao Peng 1
- Huang Ruilin 1
- Li Shuo 1
- Xinya Sun 1
- Hanyu Wang 1
- Hao Wang 1
- Hao Wang 1
- Kun Wang 1
- Peifan Wang 1
- Qingsong Wen 1
- Yuqing Wu 1
- Shu-Tao Xia 1
- Yufei Xiong 1
- Yueya Xu 1
- Pengfei Yang 1
- Xi Yang 1
- Xingyu Yang 1
- Kangwei Zeng 1
- Mingchen Zhang 1
- Shanbin Zhang 1
- Xinyuan Zhang 1
- Yechao Zhang 1
- Yihao Zhang 1
- Zhenghao Zhang 1
- Yaru Zhao 1
- Cheng Zhong 1