Ranking Responses Oriented to Conversational Relevance in Chat-bots

Bowen Wu, Baoxun Wang, Hui Xue


Abstract
For automatic chatting systems, it is indeed a great challenge to reply the given query considering the conversation history, rather than based on the query only. This paper proposes a deep neural network to address the context-aware response ranking problem by end-to-end learning, so as to help to select conversationally relevant candidate. By combining the multi-column convolutional layer and the recurrent layer, our model is able to model the semantics of the utterance sequence by grasping the semantic clue within the conversation, on the basis of the effective representation for each sentence. Especially, the network utilizes attention pooling to further emphasis the importance of essential words in conversations, thus the representations of contexts tend to be more meaningful and the performance of candidate ranking is notably improved. Meanwhile, due to the adoption of attention pooling, it is possible to visualize the semantic clues. The experimental results on the large amount of conversation data from social media have shown that our approach is promising for quantifying the conversational relevance of responses, and indicated its good potential for building practical IR based chat-bots.
Anthology ID:
C16-1063
Volume:
Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers
Month:
December
Year:
2016
Address:
Osaka, Japan
Editors:
Yuji Matsumoto, Rashmi Prasad
Venue:
COLING
SIG:
Publisher:
The COLING 2016 Organizing Committee
Note:
Pages:
652–662
Language:
URL:
https://aclanthology.org/C16-1063
DOI:
Bibkey:
Cite (ACL):
Bowen Wu, Baoxun Wang, and Hui Xue. 2016. Ranking Responses Oriented to Conversational Relevance in Chat-bots. In Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers, pages 652–662, Osaka, Japan. The COLING 2016 Organizing Committee.
Cite (Informal):
Ranking Responses Oriented to Conversational Relevance in Chat-bots (Wu et al., COLING 2016)
Copy Citation:
PDF:
https://aclanthology.org/C16-1063.pdf