Yaoyao Zhong
Author directory2026
CausalChapter: Improving Long-Form Video Chaptering with Interventional Dependency Modeling
Xinran Duan | Guozhang Li | Yaoyao Zhong | Mei Wang | Lizhi Wang | Hua Huang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Xinran Duan | Guozhang Li | Yaoyao Zhong | Mei Wang | Lizhi Wang | Hua Huang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Long-form instructional videos require automatic chaptering for efficient organization and navigation. While long-context language models can predict chapters from textualized video representations, they become costly for content-dense videos with long transcripts, smooth topic transitions, and detailed chapter descriptions. A scalable segment-then-caption paradigm reduces this cost but suffers from boundary error propagation and fragmented cross-chapter context. We propose CausalChapter, a causal-inspired interventional dependency enhancement framework for long-video chaptering. Our method estimates the observable influence of semantic units and context segments through lightweight masking and removal interventions. For boundary localization, it detects dependency changes between adjacent temporal windows via masking-based feature reconstruction; for chapter description generation, it selects cross-chapter contexts according to their influence on generated descriptions. Experiments on long-video chaptering benchmarks show consistent improvements in boundary localization, description quality, and cross-chapter coherence.
Learning How to Align: Elastic Domain Adaptation for Improving Reasoning Robustness of Large Language Models
Yujie Hou | Mei Wang | Yaoyao Zhong | Guozhang Li | Qiannan Zhu | Hua Huang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Yujie Hou | Mei Wang | Yaoyao Zhong | Guozhang Li | Qiannan Zhu | Hua Huang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Despite exceptional performance on static benchmarks, Large Language Models (LLMs) exhibit significant brittleness when evaluated on perturbed variants of the original questions. Current extrinsic interventions, prompt engineering or supervised fine-tuning, overlook an important intrinsic factor underlying this degradation: the distributional shifts in layer activations between original and perturbed questions. To address this, this work formulates the reasoning robustness challenge as an Unsupervised Domain Adaptation (UDA) problem and proposes the Elastic Domain Adaptation (EDA) method. Unlike rigid strategies that enforce a uniform alignment constraint, EDA dynamically aligns layer activations based on the specific layers and perturbation types. Specifically, EDA incorporates an Adaptive Layer Selection (ALS) to identify pivotal layers and employs an Elastic Shift Module (ESM) to selectively pull or push layer representations depending on the perturbation types. Extensive experiments across six LLMs and 15 perturbation types demonstrate that EDA achieves state-of-the-art performance on most perturbed benchmarks while preserving reasoning capability on original benchmarks.
SMART: Evaluating LLMs’ Mathematical Reasoning via a Human Cognitive Process-Inspired Benchmark
Yujie Hou | Mei Wang | Yaoyao Zhong | Ting Zhang | Xuetao Ma | Hua Huang
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Yujie Hou | Mei Wang | Yaoyao Zhong | Ting Zhang | Xuetao Ma | Hua Huang
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Large Language Models (LLMs) have achieved remarkable performance across a wide range of mathematical benchmarks. However, concerns remain as to whether these successes reflect genuine reasoning or superficial pattern recognition. Existing evaluation methods, which typically focus either on the final answer or on the intermediate reasoning steps, reduce mathematical reasoning to a shallow input–output mapping, overlooking its inherently multi-stage and multi-dimensional cognitive nature. Inspired by P’olya’s problem-solving theory, we propose SMART, a benchmark that decomposes mathematical problem-solving into four cognitive dimensions: Semantic Understanding, Mathematical Reasoning, Arithmetic Computation, and Reflection RefinemenT, and introduces dimension-specific tasks to measure the corresponding cognitive processes of LLMs. We apply SMART to 22 state-of-the-art open- and closed-source LLMs and uncover substantial discrepancies in their capabilities across dimensions. Our findings reveal genuine weaknesses in current models and motivate a new metric, the All-Pass Score, designed to better capture true problem-solving capability.
2022
Video Question Answering: Datasets, Algorithms and Challenges
Yaoyao Zhong | Wei Ji | Junbin Xiao | Yicong Li | Weihong Deng | Tat-Seng Chua
Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing
Yaoyao Zhong | Wei Ji | Junbin Xiao | Yicong Li | Weihong Deng | Tat-Seng Chua
Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing
This survey aims to sort out the recent advances in video question answering (VideoQA) and point towards future directions. We firstly categorize the datasets into 1) normal VideoQA, multi-modal VideoQA and knowledge-based VideoQA, according to the modalities invoked in the question-answer pairs, or 2) factoid VideoQA and inference VideoQA, according to the technical challenges in comprehending the questions and deriving the correct answers. We then summarize the VideoQA techniques, including those mainly designed for Factoid QA (e.g., the early spatio-temporal attention-based methods and the recently Transformer-based ones) and those targeted at explicit relation and logic inference (e.g., neural modular networks, neural symbolic methods, and graph-structured methods). Aside from the backbone techniques, we delve into the specific models and find out some common and useful insights either for video modeling, question answering, or for cross-modal correspondence learning. Finally, we point out the research trend of studying beyond factoid VideoQA to inference VideoQA, as well as towards the robustness and interpretability. Additionally, we maintain a repository, https://github.com/VRU-NExT/VideoQA, to keep trace of the latest VideoQA papers, datasets, and their open-source implementations if available. With these efforts, we strongly hope this survey could shed light on the follow-up VideoQA research.