Weihao Bo
Author directory2026
AEMAgent: Cognition-Inspired Active Memory Formation for Very-Long Video Understanding
Xian Zhao | Jiaming Zhang | Haonan Chu | Weihao Bo | Xu Chen | Delai Qiu | Yining Wang | Yi Zhang | Shengping Liu | Jian Yu | Jitao Sang
Findings of the Association for Computational Linguistics: EMNLP 2026
Xian Zhao | Jiaming Zhang | Haonan Chu | Weihao Bo | Xu Chen | Delai Qiu | Yining Wang | Yi Zhang | Shengping Liu | Jian Yu | Jitao Sang
Findings of the Association for Computational Linguistics: EMNLP 2026
Embodied AI and wearable assistants require agents to retrieve sparse evidence from continuous days-level videos. Existing memory-based methods typically follow a passive recording paradigm based on fixed-window captioning and periodic memory construction, which produces redundant memories and inefficient long-horizon reasoning. Inspired by human memory formation, we propose Active Explore Memory Agent (AEMAgent), which transforms passive recording into active memory formation by deciding when to remember, how to explore events, and when to reflect. These decisions are instantiated as a coherent pipeline: Surprise-guided Event Selection detects salient event changes for selective memory writing, Exploratory Episodic Memory Encoding enriches accepted events through self-questioning, Predictive-Coding-Guided Reflection updates knowledge from expectation-observation mismatches, and Semantic Memory Consolidation distills noisy episodic updates into compact long-term memory. Experiments on multiple benchmarks show that AEMAgent achieves the best overall performance among all compared methods while maintaining lower storage overhead than strong full-memory baselines, demonstrating the effectiveness of selective and efficient memory formation for scalable very-long video understanding.