Generating Synthetic Data for Task-Oriented Semantic Parsing with Hierarchical Representations

Ke Tran, Ming Tan


Abstract
Modern conversational AI systems support natural language understanding for a wide variety of capabilities. While a majority of these tasks can be accomplished using a simple and flat representation of intents and slots, more sophisticated capabilities require complex hierarchical representations supported by semantic parsing. State-of-the-art semantic parsers are trained using supervised learning with data labeled according to a hierarchical schema which might be costly to obtain or not readily available for a new domain. In this work, we explore the possibility of generating synthetic data for neural semantic parsing using a pretrained denoising sequence-to-sequence model (i.e., BART). Specifically, we first extract masked templates from the existing labeled utterances, and then fine-tune BART to generate synthetic utterances conditioning on the extracted templates. Finally, we use an auxiliary parser (AP) to filter the generated utterances. The AP guarantees the quality of the generated data. We show the potential of our approach when evaluating on the Facebook TOP dataset for navigation domain.
Anthology ID:
2020.spnlp-1.3
Volume:
Proceedings of the Fourth Workshop on Structured Prediction for NLP
Month:
November
Year:
2020
Address:
Online
Editors:
Priyanka Agrawal, Zornitsa Kozareva, Julia Kreutzer, Gerasimos Lampouras, André Martins, Sujith Ravi, Andreas Vlachos
Venue:
spnlp
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
17–21
Language:
URL:
https://aclanthology.org/2020.spnlp-1.3
DOI:
10.18653/v1/2020.spnlp-1.3
Bibkey:
Cite (ACL):
Ke Tran and Ming Tan. 2020. Generating Synthetic Data for Task-Oriented Semantic Parsing with Hierarchical Representations. In Proceedings of the Fourth Workshop on Structured Prediction for NLP, pages 17–21, Online. Association for Computational Linguistics.
Cite (Informal):
Generating Synthetic Data for Task-Oriented Semantic Parsing with Hierarchical Representations (Tran & Tan, spnlp 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.spnlp-1.3.pdf
Video:
 https://slideslive.com/38940155