What to Keep in Tight-Budget Dialogue Compression: Turn-Level Information Matters

Minji Park, Seunghyun Yoon, Hyuk Lim


Abstract
Dialogue histories often need to be compressed to fit within the context budgets of large language models (LLMs). However, when conversational compression occurs, turns containing critical information are sometimes removed. We study which turns should be retained to minimize information loss during task-oriented dialogue compression. On the MultiWOZ and SGD datasets, we compare four turn-level signals: Frame for task context, Evidence for question-conditioned relevance, Pivot for state changes, and Recency for later context. Evenly spaced selection (Stride) serves as a simple positional baseline.

The effectiveness of each signal depends on the question type. Evidence achieves the highest accuracy among the four signals on current-slot questions in both datasets. At a 30% word budget, Pivot improves over Stride on MultiWOZ when a state change determines the final value (0.421 versus 0.255), but is slightly worse on SGD (0.234 versus 0.245). For questions that require information from both the task context and a final value located in separate turns, Stride performs best among the compressed methods. The best selector depends on the evaluation target, and no single method is best in all settings.
Anthology ID:
2026.findings-emnlp.719
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
15123–15130
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.719/
DOI:
Bibkey:
Cite (ACL):
Minji Park, Seunghyun Yoon, and Hyuk Lim. 2026. What to Keep in Tight-Budget Dialogue Compression: Turn-Level Information Matters. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 15123–15130, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
What to Keep in Tight-Budget Dialogue Compression: Turn-Level Information Matters (Park et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.719.pdf