Machine Translation Quality and Post-Editor Productivity

Marina Sanchez-Torron, Philipp Koehn


Abstract
We assessed how different machine translation (MT) systems affect the post-editing (PE) process and product of professional English–Spanish translators. Our model found that for each 1-point increase in BLEU, there is a PE time decrease of 0.16 seconds per word, about 3-4%. The MT system with the lowest BLEU score produced the output that was post-edited to the lowest quality and with the highest PE effort, measured both in HTER and actual PE operations.
Anthology ID:
2016.amta-researchers.2
Volume:
Conferences of the Association for Machine Translation in the Americas: MT Researchers' Track
Month:
October 28 - November 1
Year:
2016
Address:
Austin, TX, USA
Editors:
Spence Green, Lane Schwartz
Venue:
AMTA
SIG:
Publisher:
The Association for Machine Translation in the Americas
Note:
Pages:
16–26
Language:
URL:
https://aclanthology.org/2016.amta-researchers.2
DOI:
Bibkey:
Cite (ACL):
Marina Sanchez-Torron and Philipp Koehn. 2016. Machine Translation Quality and Post-Editor Productivity. In Conferences of the Association for Machine Translation in the Americas: MT Researchers' Track, pages 16–26, Austin, TX, USA. The Association for Machine Translation in the Americas.
Cite (Informal):
Machine Translation Quality and Post-Editor Productivity (Sanchez-Torron & Koehn, AMTA 2016)
Copy Citation:
PDF:
https://aclanthology.org/2016.amta-researchers.2.pdf