Determining translators’ perception, productivity and post-editing effort when using SMT and NMT systems

Ariana López Pereira


Abstract
Thanks to the great progress seen in the machine translation (MT) field in recent years, the use and perception of MT by translators need to be revisited. The main objective of this paper is to determine the perception, productivity and the postediting effort (in terms of time and number of editings) of six translators when using Statistical Machine Translation (SMT) and Neural Machine Translation (NMT) systems. This presentation is focused on how translators perceive these two systems in order to know which one they prefer and what type of errors and problems present each system, as well as how translators solve these issues. These tests will be performed with the Dynamic Quality Framework (DQF) tools (quick comparison and productivity tasks) using Google Neural Machine Translation and Microsoft Translator (SMT) APIs in two different English into Spanish texts, an instruction manual and a marketing webpage. Results showed that translators considerably prefer NMT over SMT. Moreover, NMT is more adequate and fluent than SMT.
Anthology ID:
2018.eamt-main.37
Volume:
Proceedings of the 21st Annual Conference of the European Association for Machine Translation
Month:
May
Year:
2018
Address:
Alicante, Spain
Editors:
Juan Antonio Pérez-Ortiz, Felipe Sánchez-Martínez, Miquel Esplà-Gomis, Maja Popović, Celia Rico, André Martins, Joachim Van den Bogaert, Mikel L. Forcada
Venue:
EAMT
SIG:
Publisher:
Note:
Pages:
347
Language:
URL:
https://aclanthology.org/2018.eamt-main.37
DOI:
Bibkey:
Cite (ACL):
Ariana López Pereira. 2018. Determining translators’ perception, productivity and post-editing effort when using SMT and NMT systems. In Proceedings of the 21st Annual Conference of the European Association for Machine Translation, page 347, Alicante, Spain.
Cite (Informal):
Determining translators’ perception, productivity and post-editing effort when using SMT and NMT systems (López Pereira, EAMT 2018)
Copy Citation:
PDF:
https://aclanthology.org/2018.eamt-main.37.pdf