Investigation of intelligibility judgments

Florence Reeder


Abstract
This paper describes an intelligibility snap-judgment test. In this exercise, participants are shown a series of human translations and machine translations and are asked to determine whether the author was human or machine. The experiment shows that snap judgments on intelligibility are made successfully and that system rankings on snap judgments are consistent with more detailed intelligibility measures. In addition to demonstrating a quick intelligibility judgment, representing on a few minutes time of each participant, it details the types of errors which led to the snap judgments.
Anthology ID:
2004.amta-papers.25
Volume:
Proceedings of the 6th Conference of the Association for Machine Translation in the Americas: Technical Papers
Month:
September 28 - October 2
Year:
2004
Address:
Washington, USA
Editors:
Robert E. Frederking, Kathryn B. Taylor
Venue:
AMTA
SIG:
Publisher:
Springer
Note:
Pages:
227–235
Language:
URL:
https://link.springer.com/chapter/10.1007/978-3-540-30194-3_25
DOI:
Bibkey:
Cite (ACL):
Florence Reeder. 2004. Investigation of intelligibility judgments. In Proceedings of the 6th Conference of the Association for Machine Translation in the Americas: Technical Papers, pages 227–235, Washington, USA. Springer.
Cite (Informal):
Investigation of intelligibility judgments (Reeder, AMTA 2004)
Copy Citation:
PDF:
https://link.springer.com/chapter/10.1007/978-3-540-30194-3_25