Don’t Scroll Back: Missing-Evidence Memory for Streaming Dialogue Summarization

Hyangsuk Min, Hwanjun Song


Abstract
Users of modern platforms repeatedly need summaries of recent dialogue, but the window rarely contains enough context to be interpreted on its own. We formalize this setting as streaming dialogue summarization, where a system must summarize a current window using selective memory from an unbounded history under a fixed budget. We show that the central challenge is not how much history is accessed, but whether memory recovers the evidence that the current window presupposes. We construct a benchmark and evaluation protocol that separately assesses whether memory contains gap-resolving evidence and whether the generated summary reflects it. We propose ReMEMBER, a missing-evidence memory framework that conditions retrieval on unresolved window dependencies and refines retrieved chunks into evidence-dense memory under a fixed budget. Experiments on dialogues with histories up to 160K tokens show that ReMEMBER improves memory recall and gap-resolution completeness over memory construction baselines under the same budget. The code and benchmark will be released upon publication.
Anthology ID:
2026.findings-emnlp.1075
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
22728–22760
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.1075/
DOI:
10.18653/2026.findings-emnlp.1075
Bibkey:
Cite (ACL):
Hyangsuk Min and Hwanjun Song. 2026. Don’t Scroll Back: Missing-Evidence Memory for Streaming Dialogue Summarization. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 22728–22760, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Don’t Scroll Back: Missing-Evidence Memory for Streaming Dialogue Summarization (Min & Song, Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.1075.pdf