Tools and Guidelines for Principled Machine Translation Development

Nora Aranberri, Eleftherios Avramidis, Aljoscha Burchardt, Ondřej Klejch, Martin Popel, Maja Popović


Abstract
This work addresses the need to aid Machine Translation (MT) development cycles with a complete workflow of MT evaluation methods. Our aim is to assess, compare and improve MT system variants. We hereby report on novel tools and practices that support various measures, developed in order to support a principled and informed approach of MT development. Our toolkit for automatic evaluation showcases quick and detailed comparison of MT system variants through automatic metrics and n-gram feedback, along with manual evaluation via edit-distance, error annotation and task-based feedback.
Anthology ID:
L16-1296
Volume:
Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16)
Month:
May
Year:
2016
Address:
Portorož, Slovenia
Editors:
Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Sara Goggi, Marko Grobelnik, Bente Maegaard, Joseph Mariani, Helene Mazo, Asuncion Moreno, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
1877–1882
Language:
URL:
https://aclanthology.org/L16-1296
DOI:
Bibkey:
Cite (ACL):
Nora Aranberri, Eleftherios Avramidis, Aljoscha Burchardt, Ondřej Klejch, Martin Popel, and Maja Popović. 2016. Tools and Guidelines for Principled Machine Translation Development. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16), pages 1877–1882, Portorož, Slovenia. European Language Resources Association (ELRA).
Cite (Informal):
Tools and Guidelines for Principled Machine Translation Development (Aranberri et al., LREC 2016)
Copy Citation:
PDF:
https://aclanthology.org/L16-1296.pdf