C5L7: A Zero-Shot Algorithm for Intent and Slot Detection in Multilingual Task Oriented Languages

Jiun-hao Jhan, Qingxiaoyang Zhu, Nehal Bengre, Tapas Kanungo


Abstract
Voice assistants are becoming central to our lives. The convenience of using voice assistants to do simple tasks has created an industry for voice-enabled devices like TVs, thermostats, air conditioners, etc. It has also improved the quality of life of elders by making the world more accessible. Voice assistants engage in task-oriented dialogues using machine-learned language understanding models. However, training deep-learned models take a lot of training data, which is time-consuming and expensive. Furthermore, it is even more problematic if we want the voice assistant to understand hundreds of languages. In this paper, we present a zero-shot deep learning algorithm that uses only the English part of the Massive dataset and achieves a high level of accuracy across 51 languages. The algorithm uses a delexicalized translation model to generate multilingual data for data augmentation. The training data is further weighted to improve the accuracy of the worst-performing languages. We report on our experiments with code-switching, word order, multilingual ensemble methods, and other techniques and their impact on overall accuracy.
Anthology ID:
2022.mmnlu-1.7
Volume:
Proceedings of the Massively Multilingual Natural Language Understanding Workshop (MMNLU-22)
Month:
December
Year:
2022
Address:
Abu Dhabi, United Arab Emirates (Hybrid)
Editors:
Jack FitzGerald, Kay Rottmann, Julia Hirschberg, Mohit Bansal, Anna Rumshisky, Charith Peris, Christopher Hench
Venue:
MMNLU
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
62–68
Language:
URL:
https://aclanthology.org/2022.mmnlu-1.7
DOI:
10.18653/v1/2022.mmnlu-1.7
Bibkey:
Cite (ACL):
Jiun-hao Jhan, Qingxiaoyang Zhu, Nehal Bengre, and Tapas Kanungo. 2022. C5L7: A Zero-Shot Algorithm for Intent and Slot Detection in Multilingual Task Oriented Languages. In Proceedings of the Massively Multilingual Natural Language Understanding Workshop (MMNLU-22), pages 62–68, Abu Dhabi, United Arab Emirates (Hybrid). Association for Computational Linguistics.
Cite (Informal):
C5L7: A Zero-Shot Algorithm for Intent and Slot Detection in Multilingual Task Oriented Languages (Jhan et al., MMNLU 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.mmnlu-1.7.pdf
Video:
 https://aclanthology.org/2022.mmnlu-1.7.mp4