MSTree: Multi-Scale Evidence Tree for Training-Free Long-Form Video Question Answering

Chen Dongxian, Mingshuai Liu, Yijie Peng, Hengrui Liu, Xin Li


Abstract
Long-form video question answering hinges on locating brief, sparse evidence buried in minutes of dense action. Flattening the entire video into a single caption stream forces the LLM to sift through thousands of tokens, where decisive cues are easily drowned out by surrounding context. We present MSTree, a training-free framework that organizes captions into a Multi-Scale Evidence Tree. The tree is built by a coordinated dual-modal segmentation method that combines visual scene transitions and textual coherence under temporal contiguity, producing segments that are both visually and semantically consistent. Inference follows a mine-then-reason workflow: the LLM first scans coarse segment summaries to locate the most relevant event, then reasons over its fine-grained captions. When the first-round prediction falls below a confidence threshold, Contrastive Targeted Reflection (CTR) activates. The model articulates a discriminative gap that specifies what evidence is still missing to separate the top candidate answers, and an answer-anchoring constraint requires any newly retrieved evidence to both support the revised prediction and contradict the original. On EgoSchema, NExT-QA, and Video-MME, MSTree reaches 68.4%, 77.5%, and 55.7% accuracy, outperforming all training-free baselines.
Anthology ID:
2026.emnlp-main.1949
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
44321–44336
Language:
URL:
https://aclanthology.org/2026.emnlp-main.1949/
DOI:
Bibkey:
Cite (ACL):
Chen Dongxian, Mingshuai Liu, Yijie Peng, Hengrui Liu, and Xin Li. 2026. MSTree: Multi-Scale Evidence Tree for Training-Free Long-Form Video Question Answering. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 44321–44336, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
MSTree: Multi-Scale Evidence Tree for Training-Free Long-Form Video Question Answering (Dongxian et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.1949.pdf