Machine Translation for Multilingual Intent Detection and Slots Filling

Maxime De bruyn, Ehsan Lotfi, Jeska Buhmann, Walter Daelemans


Abstract
We expect to interact with home assistants irrespective of our language. However, scaling the Natural Language Understanding pipeline to multiple languages while keeping the same level of accuracy remains a challenge. In this work, we leverage the inherent multilingual aspect of translation models for the task of multilingual intent classification and slot filling. Our experiments reveal that they work equally well with general-purpose multilingual text-to-text models. Furthermore, their accuracy can be further improved by artificially increasing the size of the training set. Unfortunately, increasing the training set also increases the overlap with the test set, leading to overestimating their true capabilities. As a result, we propose two new evaluation methods capable of accounting for an overlap between the training and test set.
Anthology ID:
2022.mmnlu-1.8
Volume:
Proceedings of the Massively Multilingual Natural Language Understanding Workshop (MMNLU-22)
Month:
December
Year:
2022
Address:
Abu Dhabi, United Arab Emirates (Hybrid)
Editors:
Jack FitzGerald, Kay Rottmann, Julia Hirschberg, Mohit Bansal, Anna Rumshisky, Charith Peris, Christopher Hench
Venue:
MMNLU
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
69–82
Language:
URL:
https://aclanthology.org/2022.mmnlu-1.8
DOI:
10.18653/v1/2022.mmnlu-1.8
Bibkey:
Cite (ACL):
Maxime De bruyn, Ehsan Lotfi, Jeska Buhmann, and Walter Daelemans. 2022. Machine Translation for Multilingual Intent Detection and Slots Filling. In Proceedings of the Massively Multilingual Natural Language Understanding Workshop (MMNLU-22), pages 69–82, Abu Dhabi, United Arab Emirates (Hybrid). Association for Computational Linguistics.
Cite (Informal):
Machine Translation for Multilingual Intent Detection and Slots Filling (De bruyn et al., MMNLU 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.mmnlu-1.8.pdf
Video:
 https://aclanthology.org/2022.mmnlu-1.8.mp4