Interactive Memory Learning for Long-Term Conversations

Cai Ke, Jiangyue Yan, Han Zhang, Xin Liu, Zike Yuan, Yue Yu, Hui Wang, Ruifeng Xu


Abstract
Recent advancements in large language models have significantly enhanced the capabilities of agents in modeling long-term conversations. Despite these successes, existing approaches typically adopt a static heuristic paradigm, where information is passively archived without adaptive memory valuation. Consequently, these methods fail to self-evolve or align their memory management with evolving user needs. To address this, we propose **ICML** (**I**ntera**C**tive **M**emory **L**earning), a multi-agent framework that transforms the memory mechanism from a passive archive into a learnable, interactive memory policy. Specifically, we first employ a session synthesis pipeline to generate expert data, facilitating rapid test-time adaptation in unseen scenarios. Building on this, **ICML** utilizes an online reinforcement learning mechanism where a Planner agent selectively encodes high-value information and a Trigger agent dynamically retrieves it to optimize response quality, whereby the two agents co-evolve through continuous interaction feedback. Crucially, both agents are synchronized through a delayed reward mechanism that propagates future feedback back to earlier storage decisions, ensuring memory policies are precisely aligned with user expectations. Experimental results demonstrate that **ICML** significantly outperforms strong baselines, exhibiting the unique capability to continuously improve response quality as interactions accumulate.
Anthology ID:
2026.findings-emnlp.683
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
14336–14358
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.683/
DOI:
Bibkey:
Cite (ACL):
Cai Ke, Jiangyue Yan, Han Zhang, Xin Liu, Zike Yuan, Yue Yu, Hui Wang, and Ruifeng Xu. 2026. Interactive Memory Learning for Long-Term Conversations. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 14336–14358, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Interactive Memory Learning for Long-Term Conversations (Ke et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.683.pdf