Monolingual post-editing by a domain expert is highly effective for translation triage

Lane Schwartz


Abstract
Various small-scale pilot studies have found that for at least some documents, monolingual target language speakers may be able to successfully post-edit machine translations. We begin by analyzing previously published post-editing data to ascertain the effect, if any, of original source language on post-editing quality. Schwartz et al. (2014) hypothesized that post-editing success may be more pronounced when the monolingual post-editors are experts in the domain of the translated documents. This work tests that hypothesis by asking a domain expert to post-edit machine translations of a French scientific article (Besacier, 2014) into English. We find that the monolingual domain expert post-editor was able to successfully post-edit 86.7% of the sentences without requesting assistance from a bilingual post-editor. We evaluate the post-edited sentences according to a bilingual adequacy metric, and find that 96.5% of those sentences post-edited by only a monolingual post-editor are judged to be completely correct. These results confirm that a monolingual domain expert can successfully triage the post-editing effort, substantially reducing the workload on the bilingual post-editor by only sending the most challenging sentences to the bilingual post-editor.
Anthology ID:
2014.amta-wptp.3
Volume:
Proceedings of the 11th Conference of the Association for Machine Translation in the Americas
Month:
October 22-26
Year:
2014
Address:
Vancouver, Canada
Editors:
Sharon O'Brien, Michel Simard, Lucia Specia
Venue:
AMTA
SIG:
Publisher:
Association for Machine Translation in the Americas
Note:
Pages:
34–44
Language:
URL:
https://aclanthology.org/2014.amta-wptp.3
DOI:
Bibkey:
Cite (ACL):
Lane Schwartz. 2014. Monolingual post-editing by a domain expert is highly effective for translation triage. In Proceedings of the 11th Conference of the Association for Machine Translation in the Americas, pages 34–44, Vancouver, Canada. Association for Machine Translation in the Americas.
Cite (Informal):
Monolingual post-editing by a domain expert is highly effective for translation triage (Schwartz, AMTA 2014)
Copy Citation:
PDF:
https://aclanthology.org/2014.amta-wptp.3.pdf