What Deserves Memory: Adaptive Memory Distillation for LLM Agents

Wenquan Ma, Jiayan Nan, WenLong Wu


Abstract
Memory systems for LLM agents struggle to determine what information deserves retention. Existing approaches rely on predefined heuristics such as importance scores, emotional tags, or factual templates, encoding designer intuition rather than learning from the data itself. Inspired by cognitive ideas, we propose Nemori, an adaptive memory distillation framework that casts the assessment of the experience’s future utility as a matter of predictability. Specifically, Nemori comprises two cascading modules: Episodic Memory Integration transforms raw interactions into coherent narratives, and Semantic Knowledge Distillation extracts insights via prediction error. Centering on distillation, the framework remains agnostic to downstream management. Extensive experiments confirm that Nemori achieves strong performance, efficiency, and storage reduction. Our work suggests that observing the intrinsic properties of interaction sequences offers a viable, data-driven alternative to heuristic-based memory design.
Anthology ID:
2026.acl-long.1607
Volume:
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
July
Year:
2026
Address:
San Diego, California, United States
Editors:
Maria Liakata, Viviane P. Moreira, Jiajun Zhang, David Jurgens
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
34789–34812
Language:
URL:
https://aclanthology.org/2026.acl-long.1607/
DOI:
10.18653/v1/2026.acl-long.1607
Bibkey:
Cite (ACL):
Wenquan Ma, Jiayan Nan, and WenLong Wu. 2026. What Deserves Memory: Adaptive Memory Distillation for LLM Agents. In Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 34789–34812, San Diego, California, United States. Association for Computational Linguistics.
Cite (Informal):
What Deserves Memory: Adaptive Memory Distillation for LLM Agents (Ma et al., ACL 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.acl-long.1607.pdf
Checklist:
 2026.acl-long.1607.checklist.pdf