Finding Dominant User Utterances And System Responses in Conversations

Dhiraj Madan, Sachindra Joshi


Abstract
There are several dialog frameworks which allow manual specification of intents and rule based dialog flow. The rule based framework provides good control to dialog designers at the expense of being more time consuming and laborious. The job of a dialog designer can be reduced if we could identify pairs of user intents and corresponding responses automatically from prior conversations between users and agents. In this paper we propose an approach to find these frequent user utterances (which serve as examples for intents) and corresponding agent responses. We propose a novel SimCluster algorithm that extends standard K-means algorithm to simultaneously cluster user utterances and agent utterances by taking their adjacency information into account. The method also aligns these clusters to provide pairs of intents and response groups. We compare our results with those produced by using simple Kmeans clustering on a real dataset and observe upto 10% absolute improvement in F1-scores. Through our experiments on synthetic dataset, we show that our algorithm gains more advantage over K-means algorithm when the data has large variance.
Anthology ID:
I17-1073
Volume:
Proceedings of the Eighth International Joint Conference on Natural Language Processing (Volume 1: Long Papers)
Month:
November
Year:
2017
Address:
Taipei, Taiwan
Editors:
Greg Kondrak, Taro Watanabe
Venue:
IJCNLP
SIG:
Publisher:
Asian Federation of Natural Language Processing
Note:
Pages:
723–732
Language:
URL:
https://aclanthology.org/I17-1073
DOI:
Bibkey:
Cite (ACL):
Dhiraj Madan and Sachindra Joshi. 2017. Finding Dominant User Utterances And System Responses in Conversations. In Proceedings of the Eighth International Joint Conference on Natural Language Processing (Volume 1: Long Papers), pages 723–732, Taipei, Taiwan. Asian Federation of Natural Language Processing.
Cite (Informal):
Finding Dominant User Utterances And System Responses in Conversations (Madan & Joshi, IJCNLP 2017)
Copy Citation:
PDF:
https://aclanthology.org/I17-1073.pdf