Assessing Post-editing Effort in the English-Hindi Direction

Arafat Ahsan, Vandan Mujadia, Dipti Misra Sharma


Abstract
We present findings from a first in-depth post-editing effort estimation study in the English-Hindi direction along multiple effort indicators. We conduct a controlled experiment involving professional translators, who complete assigned tasks alternately, in a translation from scratch and a post-edit condition. We find that post-editing reduces translation time (by 63%), utilizes fewer keystrokes (by 59%), and decreases the number of pauses (by 63%) when compared to translating from scratch. We further verify the quality of translations thus produced via a human evaluation task in which we do not detect any discernible quality differences.
Anthology ID:
2021.icon-main.7
Volume:
Proceedings of the 18th International Conference on Natural Language Processing (ICON)
Month:
December
Year:
2021
Address:
National Institute of Technology Silchar, Silchar, India
Editors:
Sivaji Bandyopadhyay, Sobha Lalitha Devi, Pushpak Bhattacharyya
Venue:
ICON
SIG:
Publisher:
NLP Association of India (NLPAI)
Note:
Pages:
44–53
Language:
URL:
https://aclanthology.org/2021.icon-main.7
DOI:
Bibkey:
Cite (ACL):
Arafat Ahsan, Vandan Mujadia, and Dipti Misra Sharma. 2021. Assessing Post-editing Effort in the English-Hindi Direction. In Proceedings of the 18th International Conference on Natural Language Processing (ICON), pages 44–53, National Institute of Technology Silchar, Silchar, India. NLP Association of India (NLPAI).
Cite (Informal):
Assessing Post-editing Effort in the English-Hindi Direction (Ahsan et al., ICON 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.icon-main.7.pdf