Multilingual Neural Semantic Parsing for Low-Resourced Languages

Menglin Xia, Emilio Monti


Abstract
Multilingual semantic parsing is a cost-effective method that allows a single model to understand different languages. However, researchers face a great imbalance of availability of training data, with English being resource rich, and other languages having much less data. To tackle the data limitation problem, we propose using machine translation to bootstrap multilingual training data from the more abundant English data. To compensate for the data quality of machine translated training data, we utilize transfer learning from pretrained multilingual encoders to further improve the model. To evaluate our multilingual models on human-written sentences as opposed to machine translated ones, we introduce a new multilingual semantic parsing dataset in English, Italian and Japanese based on the Facebook Task Oriented Parsing (TOP) dataset. We show that joint multilingual training with pretrained encoders substantially outperforms our baselines on the TOP dataset and outperforms the state-of-the-art model on the public NLMaps dataset. We also establish a new baseline for zero-shot learning on the TOP dataset. We find that a semantic parser trained only on English data achieves a zero-shot performance of 44.9% exact-match accuracy on Italian sentences.
Anthology ID:
2021.starsem-1.17
Volume:
Proceedings of *SEM 2021: The Tenth Joint Conference on Lexical and Computational Semantics
Month:
August
Year:
2021
Address:
Online
Editors:
Lun-Wei Ku, Vivi Nastase, Ivan Vulić
Venue:
*SEM
SIG:
SIGLEX
Publisher:
Association for Computational Linguistics
Note:
Pages:
185–194
Language:
URL:
https://aclanthology.org/2021.starsem-1.17
DOI:
10.18653/v1/2021.starsem-1.17
Bibkey:
Cite (ACL):
Menglin Xia and Emilio Monti. 2021. Multilingual Neural Semantic Parsing for Low-Resourced Languages. In Proceedings of *SEM 2021: The Tenth Joint Conference on Lexical and Computational Semantics, pages 185–194, Online. Association for Computational Linguistics.
Cite (Informal):
Multilingual Neural Semantic Parsing for Low-Resourced Languages (Xia & Monti, *SEM 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.starsem-1.17.pdf
Code
 awslabs/multilingual-top
Data
Multilingual TOP