Beyond Static Summarization: Proactive Memory Extraction for LLM Agents

Chengyuan Yang, Zequn Sun, Wei Wei, Wei Hu


Abstract
Memory management is vital for LLM agents in long-term and personalized interactions.Most previous work studies how to retrieve and use memory, but pays less attention to how memory is extracted.We find two main limitations in existing methods.First, extraction is “ahead-of-time”: the agent saves information before it knows future tasks.A single summary prompt often mixes details, events, and relations, so useful information is lost.Second, extraction is usually one-off. Without verification, errors and hallucinations may stay in memory for a long time. To address these limitations, we propose ProMem, a proactive memory extraction framework.It separates details, events, and relations, and uses different extraction strategies for each type.It also checks completeness to recover missed events and verifies facts at the atomic level to reduce hallucinations.Experiments show that ProMem improves memory completeness and QA accuracy, while keeping a good balance between quality and token cost.
Anthology ID:
2026.findings-emnlp.1245
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
26353–26367
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.1245/
DOI:
Bibkey:
Cite (ACL):
Chengyuan Yang, Zequn Sun, Wei Wei, and Wei Hu. 2026. Beyond Static Summarization: Proactive Memory Extraction for LLM Agents. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 26353–26367, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Beyond Static Summarization: Proactive Memory Extraction for LLM Agents (Yang et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.1245.pdf