Ce Zhang
Author directoryOther people with similar names: Ce Zhang (CMU)
Unverified author pages with similar names: Ce Zhang
2026
TimeBlind: A Spatio-Temporal Compositionality Benchmark for Video LLMs
Baiqi Li | Kangyi Zhao | Ce Zhang | Chancharik Mitra | Jean De Dieu Nyandwi | Gedas Bertasius
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Baiqi Li | Kangyi Zhao | Ce Zhang | Chancharik Mitra | Jean De Dieu Nyandwi | Gedas Bertasius
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Fine-grained spatio-temporal understanding is essential for video reasoning and embodied AI. Yet, while Multimodal Large Language Models (MLLMs) master static semantics, their grasp of temporal dynamics remains brittle. We present TimeBlind, a diagnostic benchmark for compositional spatio-temporal understanding. Inspired by cognitive science, TimeBlind categorizes fine-grained temporal understanding into three levels: recognizing atomic events, characterizing event properties, and reasoning about event interdependencies. Unlike benchmarks that conflate recognition with temporal reasoning, TimeBlind leverages a minimal-pairs paradigm: video pairs share identical static visual content but differ solely in temporal structure, utilizing complementary questions to neutralize language priors. Evaluating over 20 state-of-the-art MLLMs (e.g., GPT-5, Gemini 3 Pro) on 600 curated instances (2400 video-question pairs), reveals that the Instance Accuracy (correctly distinguishing both videos in a pair) of the best performing MLLM is only 48.2%, far below the human performance (98.2%). These results demonstrate that even frontier models exhibit significant deficiencies in temporal reasoning, positioning TimeBlind as a vital diagnostic tool for next-generation video understanding.
2024
A Simple LLM Framework for Long-Range Video Question-Answering
Ce Zhang | Taixi Lu | Md Mohaiminul Islam | Ziyang Wang | Shoubin Yu | Mohit Bansal | Gedas Bertasius
Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing
Ce Zhang | Taixi Lu | Md Mohaiminul Islam | Ziyang Wang | Shoubin Yu | Mohit Bansal | Gedas Bertasius
Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing
We present LLoVi, a simple yet effective Language-based Long-range Video question-answering (LVQA) framework. Our method decomposes the short- and long-range modeling aspects of LVQA into two stages. First, we use a short-term visual captioner to generate textual descriptions of short video clips (0.5-8 seconds in length) densely sampled from a long input video. Afterward, an LLM aggregates the densely extracted short-term captions to answer a given question. Furthermore, we propose a novel multi-round summarization prompt that asks the LLM first to summarize the noisy short-term visual captions and then answer a given input question. To analyze what makes our simple framework so effective, we thoroughly evaluate various components of our framework. Our empirical analysis reveals that the choice of the visual captioner and LLM is critical for good LVQA performance. The proposed multi-round summarization prompt also leads to a significant LVQA performance boost. Our method achieves the best-reported results on the EgoSchema dataset, best known for very long-form video question-answering. LLoVi also outperforms the previous state-of-the-art by 10.2% and 6.2% on NExT-QA and IntentQA for LVQA. Finally, we extend LLoVi to grounded VideoQA, which requires both QA and temporal localization, and show that it outperforms all prior methods on NExT-GQA. Code is available at https://github.com/CeeZh/LLoVi.