A Generative Model for Joint Natural Language Understanding and Generation

Bo-Hsiang Tseng, Jianpeng Cheng, Yimai Fang, David Vandyke


Abstract
Natural language understanding (NLU) and natural language generation (NLG) are two fundamental and related tasks in building task-oriented dialogue systems with opposite objectives: NLU tackles the transformation from natural language to formal representations, whereas NLG does the reverse. A key to success in either task is parallel training data which is expensive to obtain at a large scale. In this work, we propose a generative model which couples NLU and NLG through a shared latent variable. This approach allows us to explore both spaces of natural language and formal representations, and facilitates information sharing through the latent space to eventually benefit NLU and NLG. Our model achieves state-of-the-art performance on two dialogue datasets with both flat and tree-structured formal representations. We also show that the model can be trained in a semi-supervised fashion by utilising unlabelled data to boost its performance.
Anthology ID:
2020.acl-main.163
Volume:
Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics
Month:
July
Year:
2020
Address:
Online
Editors:
Dan Jurafsky, Joyce Chai, Natalie Schluter, Joel Tetreault
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1795–1807
Language:
URL:
https://aclanthology.org/2020.acl-main.163
DOI:
10.18653/v1/2020.acl-main.163
Bibkey:
Cite (ACL):
Bo-Hsiang Tseng, Jianpeng Cheng, Yimai Fang, and David Vandyke. 2020. A Generative Model for Joint Natural Language Understanding and Generation. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 1795–1807, Online. Association for Computational Linguistics.
Cite (Informal):
A Generative Model for Joint Natural Language Understanding and Generation (Tseng et al., ACL 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.acl-main.163.pdf
Video:
 http://slideslive.com/38929001
Code
 andy194673/Joint-NLU-NLG