Jingdong Chen
Author directory2026
MemDreamer: Decoupling Perception and Reasoning for Long Video Understanding via Agentic Hierarchical Graph Memory
Cong Chen | Guo Gan | Kaixiang Ji | Zhaoyang Zhang | Zhen Yang | Guangming Yao | Hao Chen | Jingdong Chen | Yi Yuan | Chunhua Shen
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Cong Chen | Guo Gan | Kaixiang Ji | Zhaoyang Zhang | Zhen Yang | Guangming Yao | Hao Chen | Jingdong Chen | Yi Yuan | Chunhua Shen
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Current Vision-Language Models struggle with hours-long videos because processing full-length visual sequences induces prohibitive token explosion and attention dilution. To overcome this, we introduce MemDreamer to decouple perception and reasoning, shifting long-video understanding into an agentic exploration process. As a plug-and-play framework, it incrementally streams videos to construct a Hierarchical Graph Memory, a top-down three-tier architecture for semantic abstraction, anchored by a foundational graph capturing spatiotemporal and causal relations. During inference, the reasoning model employs agentic tool-augmented retrieval, navigating hierarchies, searching nodes, and traversing logical edges via an Observation-Reason-Action loop. Experiments show MemDreamer achieves SOTA results across four mainstream benchmarks, substantially narrowing the gap with human experts. It greatly reduces the reasoning context relative to full-context ingestion while delivering a substantial absolute accuracy gain. Furthermore, statistical analysis uncovers a strong positive linear correlation between an VLM’s performance on logic reasoning and long-video understanding benchmarks, establishing agentic capability scaling as a new paradigm for multimodal comprehension.
SPRI: SVD-Partitioned Residual Initialization for Data-Constrained MoE Upcycling in Speech-to-Text Translation
Weiqiao Shan | Ruixiang Mao | Yuang Li | Yuhao Zhang | Yingfeng Luo | Tong Zheng | Chen Xu | Yucheng Qiao | Chunxiang Jin | Yi Yuan | Jingdong Chen | Tong Xiao | JingBo Zhu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Weiqiao Shan | Ruixiang Mao | Yuang Li | Yuhao Zhang | Yingfeng Luo | Tong Zheng | Chen Xu | Yucheng Qiao | Chunxiang Jin | Yi Yuan | Jingdong Chen | Tong Xiao | JingBo Zhu
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Mixture-of-Experts (MoE) models enable efficient scaling, but training them from scratch remains prohibitively expensive. MoE upcycling mitigates this cost by converting pretrained dense models into sparse MoE models. However, existing upcycling methods typically rely on large-scale continued training and often perform poorly under data-constrained supervised adaptation, due to either homogeneous experts or overly disruptive perturbations to pretrained parameters. In this setting, effective upcycling must leverage pretrained weight structure while introducing sufficient diversity among routed experts. To this end, we propose SVD-Partitioned Residual Initialization (SPRI), which distributes SVD-partitioned residuals derived from pretrained feed-forward network (FFN) weights across routed experts, introducing controlled expert diversity grounded in pretrained spectral structure. We further introduce a two-stage training strategy to improve adaptation stability. We evaluate SPRI on multilingual speech-to-text translation, where limited supervised data challenges MoE upcycling and multiple target languages provide natural routing heterogeneity. On CoVoST2 across 15 En-to-X directions, SPRI improves average BLEU and COMET over fully fine-tuned dense models by 2.58 and 3.32 points, respectively, and outperforms the strongest prior MoE upcycling method by 2.44 BLEU and 3.21 COMET points. Our code is publicly available at https://github.com/shanweiqiao/SPRI.