Design of an Open-Source Architecture for Neural Machine Translation

Séamus Lankford, Haithem Afli, Andy Way


Abstract
adaptNMT is an open-source application that offers a streamlined approach to the development and deployment of Recurrent Neural Networks and Transformer models. This application is built upon the widely-adopted OpenNMT ecosystem, and is particularly useful for new entrants to the field, as it simplifies the setup of the development environment and creation of train, validation, and test splits. The application offers a graphing feature that illustrates the progress of model training, and employs SentencePiece for creating subword segmentation models. Furthermore, the application provides an intuitive user interface that facilitates hyperparameter customization. Notably, a single-click model development approach has been implemented, and models developed by adaptNMT can be evaluated using a range of metrics. To encourage eco-friendly research, adaptNMT incorporates a green report that flags the power consumption and kgCO2 emissions generated during model development. The application is freely available.
Anthology ID:
2023.crowdmt-1.2
Volume:
Proceedings of the 1st Workshop on Open Community-Driven Machine Translation
Month:
June
Year:
2023
Address:
Tampere, Finland
Editors:
Miquel Esplà-Gomis, Mikel L. Forcada, Taja Kuzman, Nikola Ljubešić, Rik van Noord, Gema Ramírez-Sánchez, Jörg Tiedemann, Antonio Toral
Venue:
CrowdMT
SIG:
Publisher:
European Association for Machine Translation
Note:
Pages:
15–20
Language:
URL:
https://aclanthology.org/2023.crowdmt-1.2
DOI:
Bibkey:
Cite (ACL):
Séamus Lankford, Haithem Afli, and Andy Way. 2023. Design of an Open-Source Architecture for Neural Machine Translation. In Proceedings of the 1st Workshop on Open Community-Driven Machine Translation, pages 15–20, Tampere, Finland. European Association for Machine Translation.
Cite (Informal):
Design of an Open-Source Architecture for Neural Machine Translation (Lankford et al., CrowdMT 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.crowdmt-1.2.pdf