Evaluating the Impact of Light Post-Editing on Usability

Sheila Castilho, Sharon O’Brien


Abstract
This paper discusses a methodology to measure the usability of machine translated content by end users, comparing lightly post-edited content with raw output and with the usability of source language content. The content selected consists of Online Help articles from a software company for a spreadsheet application, translated from English into German. Three groups of five users each used either the source text - the English version (EN) -, the raw MT version (DE_MT), or the light PE version (DE_PE), and were asked to carry out six tasks. Usability was measured using an eye tracker and cognitive, temporal and pragmatic measures of usability. Satisfaction was measured via a post-task questionnaire presented after the participants had completed the tasks.
Anthology ID:
L16-1048
Volume:
Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16)
Month:
May
Year:
2016
Address:
Portorož, Slovenia
Editors:
Nicoletta Calzolari, Khalid Choukri, Thierry Declerck, Sara Goggi, Marko Grobelnik, Bente Maegaard, Joseph Mariani, Helene Mazo, Asuncion Moreno, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association (ELRA)
Note:
Pages:
310–316
Language:
URL:
https://aclanthology.org/L16-1048
DOI:
Bibkey:
Cite (ACL):
Sheila Castilho and Sharon O’Brien. 2016. Evaluating the Impact of Light Post-Editing on Usability. In Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC'16), pages 310–316, Portorož, Slovenia. European Language Resources Association (ELRA).
Cite (Informal):
Evaluating the Impact of Light Post-Editing on Usability (Castilho & O’Brien, LREC 2016)
Copy Citation:
PDF:
https://aclanthology.org/L16-1048.pdf