MRF-Chat: Improving Dialogue with Markov Random Fields

Ishaan Grover, Matthew Huggins, Cynthia Breazeal, Hae Won Park


Abstract
Recent state-of-the-art approaches in open-domain dialogue include training end-to-end deep-learning models to learn various conversational features like emotional content of response, symbolic transitions of dialogue contexts in a knowledge graph and persona of the agent and the user, among others. While neural models have shown reasonable results, modelling the cognitive processes that humans use when conversing with each other may improve the agent’s quality of responses. A key element of natural conversation is to tailor one’s response such that it accounts for concepts that the speaker and listener may or may not know and the contextual relevance of all prior concepts used in conversation. We show that a rich representation and explicit modeling of these psychological processes can improve predictions made by existing neural network models. In this work, we propose a novel probabilistic approach using Markov Random Fields (MRF) to augment existing deep-learning methods for improved next utterance prediction. Using human and automatic evaluations, we show that our augmentation approach significantly improves the performance of existing state-of-the-art retrieval models for open-domain conversational agents.
Anthology ID:
2021.emnlp-main.403
Volume:
Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing
Month:
November
Year:
2021
Address:
Online and Punta Cana, Dominican Republic
Editors:
Marie-Francine Moens, Xuanjing Huang, Lucia Specia, Scott Wen-tau Yih
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
4925–4936
Language:
URL:
https://aclanthology.org/2021.emnlp-main.403
DOI:
10.18653/v1/2021.emnlp-main.403
Bibkey:
Cite (ACL):
Ishaan Grover, Matthew Huggins, Cynthia Breazeal, and Hae Won Park. 2021. MRF-Chat: Improving Dialogue with Markov Random Fields. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing, pages 4925–4936, Online and Punta Cana, Dominican Republic. Association for Computational Linguistics.
Cite (Informal):
MRF-Chat: Improving Dialogue with Markov Random Fields (Grover et al., EMNLP 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.emnlp-main.403.pdf
Video:
 https://aclanthology.org/2021.emnlp-main.403.mp4
Data
Blended Skill TalkConvAI2