Deep Active Learning for Dialogue Generation

Nabiha Asghar, Pascal Poupart, Xin Jiang, Hang Li


Abstract
We propose an online, end-to-end, neural generative conversational model for open-domain dialogue. It is trained using a unique combination of offline two-phase supervised learning and online human-in-the-loop active learning. While most existing research proposes offline supervision or hand-crafted reward functions for online reinforcement, we devise a novel interactive learning mechanism based on hamming-diverse beam search for response generation and one-character user-feedback at each step. Experiments show that our model inherently promotes the generation of semantically relevant and interesting responses, and can be used to train agents with customized personas, moods and conversational styles.
Anthology ID:
S17-1008
Volume:
Proceedings of the 6th Joint Conference on Lexical and Computational Semantics (*SEM 2017)
Month:
August
Year:
2017
Address:
Vancouver, Canada
Editors:
Nancy Ide, Aurélie Herbelot, Lluís Màrquez
Venue:
*SEM
SIGs:
SIGLEX | SIGSEM
Publisher:
Association for Computational Linguistics
Note:
Pages:
78–83
Language:
URL:
https://aclanthology.org/S17-1008
DOI:
10.18653/v1/S17-1008
Bibkey:
Cite (ACL):
Nabiha Asghar, Pascal Poupart, Xin Jiang, and Hang Li. 2017. Deep Active Learning for Dialogue Generation. In Proceedings of the 6th Joint Conference on Lexical and Computational Semantics (*SEM 2017), pages 78–83, Vancouver, Canada. Association for Computational Linguistics.
Cite (Informal):
Deep Active Learning for Dialogue Generation (Asghar et al., *SEM 2017)
Copy Citation:
PDF:
https://aclanthology.org/S17-1008.pdf