Task-Oriented Moment Localization for Long Video Understanding with Near-Second Coverage

Xiangrui Liu, Minghao Qin, Yan Shu, Zhengyang Liang, Yang Tian, Chen Jason Zhang, Bo Zhao, Zheng Liu


Abstract
Long-video understanding (LVU) is increasingly framed as an agentic process that iteratively localizes task-critical moments before perception and reasoning. Moment localization is therefore a key bottleneck: under long-video context constraints, sparse sampling can easily miss decisive evidence, while similarity-based retrieval often returns semantically related but task-irrelevant clips. We present EviScan, an evidence-seeking moment localization model built on an MLLM, designed for task-oriented localization and near-second temporal scanning on hour-long videos. To learn task-oriented localization, we construct ToMo-Pile, a training set that pairs temporal intervals with rationale traces explaining why the interval resolves the task. To make near-second scanning feasible on long videos, EviScan uses DualKV Prefill for memory-efficient streaming inference, and Progressive Localization to first narrow down candidate intervals and then refine boundaries using high-resolution evidence. We further introduce ToMo-Bench, a benchmark for task-oriented moment localization across diverse long-video scenarios. EviScan consistently outperforms specialized localizers and general-purpose MLLMs on both ToMo-Bench and standard temporal grounding benchmarks. When used as a plug-in localization module, it yields substantial gains on downstream long-video understanding benchmarks (MLVU and LongVideoBench), and these gains are larger than those brought by other moment-localization methods. We will release the model, dataset, benchmark, and code.
Anthology ID:
2026.emnlp-main.2144
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
48748–48769
Language:
URL:
https://aclanthology.org/2026.emnlp-main.2144/
DOI:
Bibkey:
Cite (ACL):
Xiangrui Liu, Minghao Qin, Yan Shu, Zhengyang Liang, Yang Tian, Chen Jason Zhang, Bo Zhao, and Zheng Liu. 2026. Task-Oriented Moment Localization for Long Video Understanding with Near-Second Coverage. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 48748–48769, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Task-Oriented Moment Localization for Long Video Understanding with Near-Second Coverage (Liu et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.2144.pdf