Najibul Haque Sarker
Author directory2026
NEST: Narrative Event Structures in Time for Long Video Understanding
Ali Asgarov | Kaushik Narasimhan | Najibul Haque Sarker | Hani Alomari | Chia-Wei Tang | Anushka Sivakumar | Zaber Ibn Abdul Hakim | Shaurya Mallampati | Chris Thomas
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Ali Asgarov | Kaushik Narasimhan | Najibul Haque Sarker | Hani Alomari | Chia-Wei Tang | Anushka Sivakumar | Zaber Ibn Abdul Hakim | Shaurya Mallampati | Chris Thomas
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Recent progress in vision-language models has enabled processing of increasingly long video sequences, but handling extended token streams does not translate to understanding complex narrative structure in long videos. Existing long-video benchmarks focus on needle-in-a-haystack retrieval rather than evaluating how low-level actions form events, interact across time, and drive narratives, for example whether a model can connect an early job loss to a later relationship breakup despite intervening scenes or flashbacks. We introduce NEST (Narrative Event Structures in Time for Long Video Understanding), a dataset of 1,005 full-length movies (avg. 98 minutes), each annotated with about 103 multimodal narrative events grounded in visual content, dialogue, and audio. NEST links these events through relations that reflect narrative structure, including explicit temporal ordering, hierarchical composition, and long-range dependencies. We introduce baselines for event trigger detection (ETD), event localization (EL), event argument extraction (EAE), and event relation extraction (ERE). The benchmark is highly challenging for grounded event discovery, with the best performance across evaluated zero-shot models on main evaluation subsets remaining below 8% for ETD, 6% for EL, and 11% for EAE. In contrast, ERE is more tractable once events are given, reaching 34.23% F1 zero-shot and 49.20% F1 after fine-tuning.
M3EC: A Multimodal Multidocument Benchmark for Event Extraction and Event Coreference Resolution
Zaber Ibn Abdul Hakim | Najibul Haque Sarker | Aafiya Hussain | Hani Alomari | Alvi Md Ishmam | Ali Asgarov | Chia-Wei Tang | Chris Thomas
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Zaber Ibn Abdul Hakim | Najibul Haque Sarker | Aafiya Hussain | Hani Alomari | Alvi Md Ishmam | Ali Asgarov | Chia-Wei Tang | Chris Thomas
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Understanding how the same real-world event is represented across text, video, and audio remains a fundamental challenge in information extraction. While prior datasets have explored events within individual modalities or limited modality pairs, a setting that combines all three modalities remains largely unexplored. We introduce M3EC (Multimodal Multidocument Event Coreference), a new benchmark for multimodal, multidocument event extraction and coreference resolution. It is built from tightly related news clusters that combine eventful videos, audio files, and news articles. We also introduce a semi-automated annotation pipeline, AutoEventAnnotator, to generate automated annotations at scale. Additionally, we construct a human-annotated test set for robust evaluation. To our knowledge, this is the first benchmark to support cluster-level multidocument event extraction and event coreference across text, video, and audio. Evaluation with strong multimodal LLMs shows that the majority of them fail to extract valid events in video and particularly in audio. We further show that models finetuned on the annotations generated by our automated pipeline achieve consistent improvements, including more than +30 F1 on video event extraction, +15 F1 on audio event extraction, and +40 CoNLL F1 on end-to-end coreference resolution, highlighting the usefulness of M3EC for training and evaluation in multimodal event understanding.