Policy-Driven Neural Response Generation for Knowledge-Grounded Dialog Systems

Behnam Hedayatnia, Karthik Gopalakrishnan, Seokhwan Kim, Yang Liu, Mihail Eric, Dilek Hakkani-Tur


Abstract
Open-domain dialog systems aim to generate relevant, informative and engaging responses. In this paper, we propose using a dialog policy to plan the content and style of target, open domain responses in the form of an action plan, which includes knowledge sentences related to the dialog context, targeted dialog acts, topic information, etc. For training, the attributes within the action plan are obtained by automatically annotating the publicly released Topical-Chat dataset. We condition neural response generators on the action plan which is then realized as target utterances at the turn and sentence levels. We also investigate different dialog policy models to predict an action plan given the dialog context. Through automated and human evaluation, we measure the appropriateness of the generated responses and check if the generation models indeed learn to realize the given action plans. We demonstrate that a basic dialog policy that operates at the sentence level generates better responses in comparison to turn level generation as well as baseline models with no action plan. Additionally the basic dialog policy has the added benefit of controllability.
Anthology ID:
2020.inlg-1.46
Volume:
Proceedings of the 13th International Conference on Natural Language Generation
Month:
December
Year:
2020
Address:
Dublin, Ireland
Editors:
Brian Davis, Yvette Graham, John Kelleher, Yaji Sripada
Venue:
INLG
SIG:
SIGGEN
Publisher:
Association for Computational Linguistics
Note:
Pages:
412–421
Language:
URL:
https://aclanthology.org/2020.inlg-1.46
DOI:
10.18653/v1/2020.inlg-1.46
Bibkey:
Cite (ACL):
Behnam Hedayatnia, Karthik Gopalakrishnan, Seokhwan Kim, Yang Liu, Mihail Eric, and Dilek Hakkani-Tur. 2020. Policy-Driven Neural Response Generation for Knowledge-Grounded Dialog Systems. In Proceedings of the 13th International Conference on Natural Language Generation, pages 412–421, Dublin, Ireland. Association for Computational Linguistics.
Cite (Informal):
Policy-Driven Neural Response Generation for Knowledge-Grounded Dialog Systems (Hedayatnia et al., INLG 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.inlg-1.46.pdf