Shuning Wang
Author directory2026
OVIBench: Benchmarking Online Video Question Answering under Interruption
Naiming Liu | Zhiheng Wu | Shuning Wang | Tie Zhang | Bowen Liu | Tong Wang
Findings of the Association for Computational Linguistics: EMNLP 2026
Naiming Liu | Zhiheng Wu | Shuning Wang | Tie Zhang | Bowen Liu | Tong Wang
Findings of the Association for Computational Linguistics: EMNLP 2026
Recent vision language models (VLMs) have achieved strong progress in video understanding. However, most existing video QA research and benchmarks still follow an offline, single-round paradigm, overlooking realistic interactions where users may interrupt the model during answer generation. To address this gap, we study online video QA under interruptions. We formulate the Online Video Question Answering under Interruption task and introduce OVIBench, the first standardized benchmark for this setting. OVIBench categorizes interruptions into three types: Cancellation, False Trigger, Correction and supports both open-ended and multiple-choice evaluations. To enable large-scale and reproducible testing, we develop an offline simulation protocol that reproduces interruption during generation under a unified temporal setup, together with a multi-dimensional metric suite for assessing interruption understanding and response generation. Experiments reveal clear weaknesses of mainstream VLMs in this setting, especially in reliably following user correction requests. Finally, we construct a train set OVI-Train for interruption-aware fine-tuning, which yields significant gains on OVIBench and validates the effectiveness of our benchmark and data design. OVIBench, OVI-Train, and the evaluation code will be released.
See More, Think Deeper: Query-Expanded Visual Evidence and Answer-Clue Guided Reflection for Long Video Understanding
Shuning Wang | Zhiheng Wu | YiNuo LU | Naiming Liu | Chen Jia | Bowen Liu | Shuo Nie | Weijie Zhu | Yumeng Zhang
Findings of the Association for Computational Linguistics: EMNLP 2026
Shuning Wang | Zhiheng Wu | YiNuo LU | Naiming Liu | Chen Jia | Bowen Liu | Shuo Nie | Weijie Zhu | Yumeng Zhang
Findings of the Association for Computational Linguistics: EMNLP 2026
Recent advances in Video Large Language Models (Video-LLMs) have enabled performance on long-video understanding tasks. However, existing methods still face two key limitations: evidence acquisition often relies on a single search intent, and answer generation lacks an effective visual feedback mechanism. To address these limitations, we propose CoVER, a Comprehensive Visual Evidence and Reflection framework for long-video understanding. CoVER enables Video-LLMs to See More by dynamically gathering query-expanded visual evidence, and Think Deeper by verifying draft answers with effective answer-specific visual feedback. Together, these mechanisms shift long-video understanding from answer-centric generation to evidence-centric and visually verifiable reasoning. Experimental results show that CoVER-7B substantially outperforms models with the same parameter scale and even surpasses state-of-the-art closed-source models on certain metrics.
MemWM: Memory-Augmented Text-Based World Model
Yujun Wang | Tao Zhang | Jinhe Bi | Aniri | Wenxuan Ye | Boliang Liu | Sikuan Yan | Shuning Wang | Xuebing Zhou | Soren Pirk | Hinrich Schuetze | Yunpu Ma
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Yujun Wang | Tao Zhang | Jinhe Bi | Aniri | Wenxuan Ye | Boliang Liu | Sikuan Yan | Shuning Wang | Xuebing Zhou | Soren Pirk | Hinrich Schuetze | Yunpu Ma
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
World models are increasingly used to support planning in agents by predicting how environment states evolve in response to agent actions. Yet fluent next-state predictions can still omit task-critical facts, corrupt product attributes, or apply incorrect transition rules. To address such systematic prediction errors, we introduce MemWM, a memory-augmented text-based world model. MemWM uses world memory, a curated memory bank of transition rules, state caches, and hard-to-predict facts, to condition next-state imagination. We evaluate factual state preservation with Structured State Fidelity (SSF), which scores predicted states through benchmark-specific facts and fields. Compared with SFT, memory-augmented training improves SSF by up to 206.3%. In the full planning setting, we keep the policy model frozen and provide policy-side world skill: retrieved task-level skills and step-wise corrective guidance for action selection. Across ALFWorld, WebShop, and ScienceWorld, memory-augmented agents improve downstream success over an SFT-trained world-model agent, with up to a 65.4% relative gain. Sensitivity analyses further show that retrieved memory improves task success and efficiency under different memory and action-budget settings.