Interactive Question Clarification in Dialogue via Reinforcement Learning

Xiang Hu, Zujie Wen, Yafang Wang, Xiaolong Li, Gerard de Melo


Abstract
Coping with ambiguous questions has been a perennial problem in real-world dialogue systems. Although clarification by asking questions is a common form of human interaction, it is hard to define appropriate questions to elicit more specific intents from a user. In this work, we propose a reinforcement model to clarify ambiguous questions by suggesting refinements of the original query. We first formulate a collection partitioning problem to select a set of labels enabling us to distinguish potential unambiguous intents. We list the chosen labels as intent phrases to the user for further confirmation. The selected label along with the original user query then serves as a refined query, for which a suitable response can more easily be identified. The model is trained using reinforcement learning with a deep policy network. We evaluate our model based on real-world user clicks and demonstrate significant improvements across several different experiments.
Anthology ID:
2020.coling-industry.8
Volume:
Proceedings of the 28th International Conference on Computational Linguistics: Industry Track
Month:
December
Year:
2020
Address:
Online
Editors:
Ann Clifton, Courtney Napoles
Venue:
COLING
SIG:
Publisher:
International Committee on Computational Linguistics
Note:
Pages:
78–89
Language:
URL:
https://aclanthology.org/2020.coling-industry.8
DOI:
10.18653/v1/2020.coling-industry.8
Bibkey:
Cite (ACL):
Xiang Hu, Zujie Wen, Yafang Wang, Xiaolong Li, and Gerard de Melo. 2020. Interactive Question Clarification in Dialogue via Reinforcement Learning. In Proceedings of the 28th International Conference on Computational Linguistics: Industry Track, pages 78–89, Online. International Committee on Computational Linguistics.
Cite (Informal):
Interactive Question Clarification in Dialogue via Reinforcement Learning (Hu et al., COLING 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.coling-industry.8.pdf