Weicheng Fang
Author directory2026
MEMOBench: A Process Level Memory Benchmark for Robotic Manipulation
Haiyang Sun | Haoxiao Wang | Junming Chen | Weicheng Fang | Zihao Su | Jingkun Yi | Wenyou Yi | Hao Chen | Zhou Zhao
Findings of the Association for Computational Linguistics: EMNLP 2026
Haiyang Sun | Haoxiao Wang | Junming Chen | Weicheng Fang | Zihao Su | Jingkun Yi | Wenyou Yi | Hao Chen | Zhou Zhao
Findings of the Association for Computational Linguistics: EMNLP 2026
Robotic manipulation often requires actingon information that is no longer visible, yet Vision-Language-Action policies are usually evaluated when the current observation largely determines the next action. Existing robotic memory benchmarks expose this gap, but they still rely mainly on final task success and there-fore conflate forgetting with manipulation failure. We present MEMOBench, a benchmark for process level memory evaluation in robotic manipulation. MEMOBench includes 30 history dependent tasks, 1,500 expert demonstrations, and 4,200 executable checkpoint instances from 84 templates. Each checkpointpairs coarse to fine language with a simulator predicate and labels one memory operation:Storage, Update, or Compression. These annotations define Memory Storage Rate, MemoryUpdate Rate, and Memory Compression Rate,which measure memory fidelity alongside tasksuccess. Across standard and memory augmented VLA policies, the strongest memory module baseline reaches only 31.9%o average success rate, and high storage often coexists with weak update and compression. Checkpoint language also supervises semantic, contrastive, and framewise memory alignment objectives, yielding modest gains across differentmemory operations. MEMOBench provides a diagnostic evaluation suite and training supervision for memory grounded robotic policies. The project page is available at https://github.com/Collab-Gen/MEMoBench.