Grounding Memory Summarization in Utility Intent

Zhenyu Lei, Mingjia Shi, Xingbo Fu, Haoyu He, Qi R. Wang, Jundong Li


Abstract
Existing summarizers for memory systems are typically optimized for human-facing criteria such as faithfulness, which misaligns with their true objective: preserving the evidence needed to support future queries. We show that conditioning summarization on query-answer pairs substantially improves answer quality, and that this utility-aware behavior is transferable across queries. Motivated by these findings, we propose MemSuit, a self-distillation framework in which a teacher summarizer, conditioned on observed query-answer pairs, produces utility-aware memory entries that a student learns to reproduce from the raw conversation alone. To prevent collateral erasure where conditioning on a single query-answer pair discards evidence relevant to other plausible queries, the teacher decomposes each block into multiple self-contained entries that preserve distinct query-relevant facets as independently retrievable units. To align the retriever with the compact, fact-dense style of teacher entries, we further fine-tune the embedding model with a contrastive objective supervised by teacher entries. Across a diverse suite of conversational query types, MemSuit consistently outperforms state-of-the-art baselines, confirming the value of grounding memory in downstream utility.
Anthology ID:
2026.emnlp-main.358
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
8195–8209
Language:
URL:
https://aclanthology.org/2026.emnlp-main.358/
DOI:
Bibkey:
Cite (ACL):
Zhenyu Lei, Mingjia Shi, Xingbo Fu, Haoyu He, Qi R. Wang, and Jundong Li. 2026. Grounding Memory Summarization in Utility Intent. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 8195–8209, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Grounding Memory Summarization in Utility Intent (Lei et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.358.pdf