Bounded Conversational Memory with Hybrid Retrieval and Evidence Highlighting for Multi-Session Dialogue Systems

Manasa Mudunuri, Chandra Kiran Guntupalli, Mario Michael Kubek, Shiraj Pokharel, Murray Patterson


Abstract
Across independent sessions, dialogue systems built on large language models do not retain prior context unless an external memory layer organizes and retrieves it. Most memory sys- tems treat this as a retrieval problem, assuming that surfacing the right past content is the pri- mary lever for accuracy. We report evidence that this view is incomplete: holding retrieval fixed, how retrieved context is organized and presented to the model is an independent and substantial driver of answer accuracy. We demonstrate this with the Context Persistence Protocol (CPP), a modular memory layer that groups dialogue into topically coherent seg- ments, retrieves them with hybrid lexical and semantic search, and highlights the single most informative sentence in each segment before generation. Across two long-term memory benchmarks, CPP attains session-level retrieval scores that are identical to those of an un- bounded flat-retrieval baseline on LoCoMo and slightly lower on LongMemEval, yet it answers substantially more questions correctly, with the largest gains on multi-hop reasoning. These results suggest that the organization and presentation of retrieved context, rather than retrieval coverage alone, is a major driver of the difference.
Anthology ID:
2026.sigdial-1.55
Volume:
Proceedings of the 27th Annual Meeting of the Special Interest Group on Discourse and Dialogue
Month:
August
Year:
2026
Address:
Atlanta, Georgia, USA
Editors:
Jinho D. Choi, Yun-Nung Chen, Kotaro Funakoshi, Ali Emami
Venue:
SIGDIAL
SIG:
SIGDIAL
Publisher:
Association for Computational Linguistics
Note:
Pages:
786–794
Language:
URL:
https://aclanthology.org/2026.sigdial-1.55/
DOI:
Bibkey:
Cite (ACL):
Manasa Mudunuri, Chandra Kiran Guntupalli, Mario Michael Kubek, Shiraj Pokharel, and Murray Patterson. 2026. Bounded Conversational Memory with Hybrid Retrieval and Evidence Highlighting for Multi-Session Dialogue Systems. In Proceedings of the 27th Annual Meeting of the Special Interest Group on Discourse and Dialogue, pages 786–794, Atlanta, Georgia, USA. Association for Computational Linguistics.
Cite (Informal):
Bounded Conversational Memory with Hybrid Retrieval and Evidence Highlighting for Multi-Session Dialogue Systems (Mudunuri et al., SIGDIAL 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.sigdial-1.55.pdf