Attentive fine-tuning of Transformers for Translation of low-resourced languages @LoResMT 2021

Karthik Puranik, Adeep Hande, Ruba Priyadharshini, Thenmozi Durairaj, Anbukkarasi Sampath, Kingston Pal Thamburaj, Bharathi Raja Chakravarthi


Abstract
This paper reports the Machine Translation (MT) systems submitted by the IIITT team for the English→Marathi and English⇔Irish language pairs LoResMT 2021 shared task. The task focuses on getting exceptional translations for rather low-resourced languages like Irish and Marathi. We fine-tune IndicTrans, a pretrained multilingual NMT model for English→Marathi, using external parallel corpus as input for additional training. We have used a pretrained Helsinki-NLP Opus MT English⇔Irish model for the latter language pair. Our approaches yield relatively promising results on the BLEU metrics. Under the team name IIITT, our systems ranked 1, 1, and 2 in English→Marathi, Irish→English, and English→Irish respectively. The codes for our systems are published1 .
Anthology ID:
2021.mtsummit-loresmt.14
Volume:
Proceedings of the 4th Workshop on Technologies for MT of Low Resource Languages (LoResMT2021)
Month:
August
Year:
2021
Address:
Virtual
Editors:
John Ortega, Atul Kr. Ojha, Katharina Kann, Chao-Hong Liu
Venue:
LoResMT
SIG:
Publisher:
Association for Machine Translation in the Americas
Note:
Pages:
134–143
Language:
URL:
https://aclanthology.org/2021.mtsummit-loresmt.14
DOI:
Bibkey:
Cite (ACL):
Karthik Puranik, Adeep Hande, Ruba Priyadharshini, Thenmozi Durairaj, Anbukkarasi Sampath, Kingston Pal Thamburaj, and Bharathi Raja Chakravarthi. 2021. Attentive fine-tuning of Transformers for Translation of low-resourced languages @LoResMT 2021. In Proceedings of the 4th Workshop on Technologies for MT of Low Resource Languages (LoResMT2021), pages 134–143, Virtual. Association for Machine Translation in the Americas.
Cite (Informal):
Attentive fine-tuning of Transformers for Translation of low-resourced languages @LoResMT 2021 (Puranik et al., LoResMT 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.mtsummit-loresmt.14.pdf
Code
 karthikpuranik11/loresmt
Data
OPUS-MT