Learning How to Remember: A Meta-Cognitive Management Method for Structured and Transferable Agent Memory

Sirui Liang, Pengfei Cao, Jian Zhao, Wenhao Teng, Xiangwen Liao, Jun Zhao, Kang Liu


Abstract
Large language model (LLM) agents increasingly rely on accumulated memory to solve long-horizon decision-making tasks. However, most existing approaches store memory in fixed representations and reuse it at a single or implicit level of abstraction, which limits generalization and often leads to negative transfer when distribution shift. This paper proposes the Meta-Cognitive Memory Abstraction method (MCMA), which treats memory abstraction as a learnable cognitive skill rather than a fixed design choice. MCMA decouples task execution from memory management by combining a frozen task model with a learned memory copilot. The memory copilot is trained using direct preference optimization; it determines how experience should be structured, abstracted, and reused. Memories are further organized into a hierarchy of abstraction levels, enabling selective reuse based on task similarity. When no memory is transferable, MCMA transfers the ability to abstract and manage memory by transferring the memory copilot. Experiments on ALFWorld, ScienceWorld, and BabyAI demonstrate substantial improvements in performance, out-of-distribution generalization, and cross-task transfer over several baselines.
Anthology ID:
2026.findings-acl.1535
Volume:
Findings of the Association for Computational Linguistics: ACL 2026
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
30733–30753
Language:
URL:
https://aclanthology.org/2026.findings-acl.1535/
DOI:
Bibkey:
Cite (ACL):
Sirui Liang, Pengfei Cao, Jian Zhao, Wenhao Teng, Xiangwen Liao, Jun Zhao, and Kang Liu. 2026. Learning How to Remember: A Meta-Cognitive Management Method for Structured and Transferable Agent Memory. In Findings of the Association for Computational Linguistics: ACL 2026, pages 30733–30753, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
Learning How to Remember: A Meta-Cognitive Management Method for Structured and Transferable Agent Memory (Liang et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-acl.1535.pdf
Checklist:
 2026.findings-acl.1535.checklist.pdf