Improving Multilingual Neural Machine Translation For Low-Resource Languages: French, English - Vietnamese

Thi-Vinh Ngo, Phuong-Thai Nguyen, Thanh-Le Ha, Khac-Quy Dinh, Le-Minh Nguyen


Abstract
Prior works have demonstrated that a low-resource language pair can benefit from multilingual machine translation (MT) systems, which rely on many language pairs’ joint training. This paper proposes two simple strategies to address the rare word issue in multilingual MT systems for two low-resource language pairs: French-Vietnamese and English-Vietnamese. The first strategy is about dynamical learning word similarity of tokens in the shared space among source languages while another one attempts to augment the translation ability of rare words through updating their embeddings during the training. Besides, we leverage monolingual data for multilingual MT systems to increase the amount of synthetic parallel corpora while dealing with the data sparsity problem. We have shown significant improvements of up to +1.62 and +2.54 BLEU points over the bilingual baseline systems for both language pairs and released our datasets for the research community.
Anthology ID:
2020.loresmt-1.8
Volume:
Proceedings of the 3rd Workshop on Technologies for MT of Low Resource Languages
Month:
December
Year:
2020
Address:
Suzhou, China
Editors:
Alina Karakanta, Atul Kr. Ojha, Chao-Hong Liu, Jade Abbott, John Ortega, Jonathan Washington, Nathaniel Oco, Surafel Melaku Lakew, Tommi A Pirinen, Valentin Malykh, Varvara Logacheva, Xiaobing Zhao
Venue:
LoResMT
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
55–61
Language:
URL:
https://aclanthology.org/2020.loresmt-1.8
DOI:
Bibkey:
Cite (ACL):
Thi-Vinh Ngo, Phuong-Thai Nguyen, Thanh-Le Ha, Khac-Quy Dinh, and Le-Minh Nguyen. 2020. Improving Multilingual Neural Machine Translation For Low-Resource Languages: French, English - Vietnamese. In Proceedings of the 3rd Workshop on Technologies for MT of Low Resource Languages, pages 55–61, Suzhou, China. Association for Computational Linguistics.
Cite (Informal):
Improving Multilingual Neural Machine Translation For Low-Resource Languages: French, English - Vietnamese (Ngo et al., LoResMT 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.loresmt-1.8.pdf