Dialogue Generation on Infrequent Sentence Functions via Structured Meta-Learning

Yifan Gao, Piji Li, Wei Bi, Xiaojiang Liu, Michael Lyu, Irwin King


Abstract
Sentence function is an important linguistic feature indicating the communicative purpose in uttering a sentence. Incorporating sentence functions into conversations has shown improvements in the quality of generated responses. However, the number of utterances for different types of fine-grained sentence functions is extremely imbalanced. Besides a small number of high-resource sentence functions, a large portion of sentence functions is infrequent. Consequently, dialogue generation conditioned on these infrequent sentence functions suffers from data deficiency. In this paper, we investigate a structured meta-learning (SML) approach for dialogue generation on infrequent sentence functions. We treat dialogue generation conditioned on different sentence functions as separate tasks, and apply model-agnostic meta-learning to high-resource sentence functions data. Furthermore, SML enhances meta-learning effectiveness by promoting knowledge customization among different sentence functions but simultaneously preserving knowledge generalization for similar sentence functions. Experimental results demonstrate that SML not only improves the informativeness and relevance of generated responses, but also can generate responses consistent with the target sentence functions. Code will be public to facilitate the research along this line.
Anthology ID:
2020.findings-emnlp.40
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2020
Month:
November
Year:
2020
Address:
Online
Editors:
Trevor Cohn, Yulan He, Yang Liu
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
431–440
Language:
URL:
https://aclanthology.org/2020.findings-emnlp.40
DOI:
10.18653/v1/2020.findings-emnlp.40
Bibkey:
Cite (ACL):
Yifan Gao, Piji Li, Wei Bi, Xiaojiang Liu, Michael Lyu, and Irwin King. 2020. Dialogue Generation on Infrequent Sentence Functions via Structured Meta-Learning. In Findings of the Association for Computational Linguistics: EMNLP 2020, pages 431–440, Online. Association for Computational Linguistics.
Cite (Informal):
Dialogue Generation on Infrequent Sentence Functions via Structured Meta-Learning (Gao et al., Findings 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.findings-emnlp.40.pdf
Video:
 https://slideslive.com/38940696