DramaSearch: Benchmarking Multimodal Searching Agents in Ultra-long TV Dramas

Yunning Cao, Jiannan Ge, Chuanbin Liu, Lingxi Xie, Xinyue Huo, Pengfei Chen, Kaiwen Duan, Hongtao Xie, Yongdong Zhang, Qi Tian


Abstract
Searching agents have achieved significant progress in NLP, yet their multimodal counterparts are constrained by a lack of suitable evaluation benchmarks requiring reasoning over continuous video, audio, and images. We propose long-form TV dramas as a natural solution and introduce DramaSearch, encompassing 3,600 riddles across 9 dramas totaling 239 hours. Our dataset is generated via a graph-constrained pipeline that processes enriched captions into structured events and multi-granularity evidence views. By employing character-to-view and entity-to-view indexing, we ensure controllable clue disclosure and strictly unique answers. The riddles are categorized into multi-clue, multi-hop, and compositional types, requiring agents to aggregate isolated clues and navigate complex dependency chains. Experiments demonstrate that a Qwen3-8B agent, trained on a held-out set using SFT and RL, achieves an accuracy of 48.3%. This result establishes a strong baseline that performs favorably against zero-shot GPT-5 (37.0%), while indicating significant room for future research. All data and code will be publicly released.
Anthology ID:
2026.findings-emnlp.1313
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
27798–27826
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.1313/
DOI:
Bibkey:
Cite (ACL):
Yunning Cao, Jiannan Ge, Chuanbin Liu, Lingxi Xie, Xinyue Huo, Pengfei Chen, Kaiwen Duan, Hongtao Xie, Yongdong Zhang, and Qi Tian. 2026. DramaSearch: Benchmarking Multimodal Searching Agents in Ultra-long TV Dramas. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 27798–27826, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
DramaSearch: Benchmarking Multimodal Searching Agents in Ultra-long TV Dramas (Cao et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.1313.pdf