Learning Diagnostic Clarifying Questions for Conversational Question Answering via Data-Efficient Dynamic Distillation

Jihyeong Jeon, Cheol Ryu, U Kang


Abstract
Given a query, how can a QA system ask an informative clarifying question to accurately answer it? Open-domain conversational question answering requires not only detecting when a query is ambiguous but also asking clarifying questions that efficiently uncover the latent intent of the user. However, existing approaches either rely on prompt-only clarify-or-answer decisions with limited robustness or distill clarification trajectories without explicitly modeling intent convergence. In this paper, we propose D4CQ (Data-Efficient Diagnosticity based Dynamic Distillation for Clarifying Question), a data-efficient framework for learning diagnostic clarifying questions through dynamic distillation. Our approach distills a structured refinement protocol, prioritizes informative clarifications via diagnosticity-based reweighting, and improves sample efficiency through hindsight relabeling. Empirical results demonstrates that D4CQ consistently outperforms strong baselines, while maintaining comparable interaction budgets. Our code is available at https://github.com/ddddcq/d4cq.
Anthology ID:
2026.emnlp-main.22
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
484–498
Language:
URL:
https://aclanthology.org/2026.emnlp-main.22/
DOI:
Bibkey:
Cite (ACL):
Jihyeong Jeon, Cheol Ryu, and U Kang. 2026. Learning Diagnostic Clarifying Questions for Conversational Question Answering via Data-Efficient Dynamic Distillation. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 484–498, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Learning Diagnostic Clarifying Questions for Conversational Question Answering via Data-Efficient Dynamic Distillation (Jeon et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.22.pdf