Long to reign over us: A Case Study of Machine Translation and a New Monarch

Rebecca Knowles, Samuel Larkin


Abstract
Novel terminology and changes in terminology are often a challenge for machine translation systems. The passing of Queen Elizabeth II and the accession of King Charles III provide a striking example of translation shift in the real world, particularly in translation contexts that have ambiguity. Examining translation between French and English, we present a focused case-study of translations about King Charles III as produced both by publicly-available MT systems and by a neural machine translation system trained specifically on Canadian parliamentary text. We find that even in cases where human translators would have adequate context to disambiguate terms from the source language, machine translation systems do not always produce the expected output. Where we are able to analyze the training data, we note that this may represent artifacts in the data, raising important questions about machine translation updates in light of real world events.
Anthology ID:
2023.findings-acl.412
Volume:
Findings of the Association for Computational Linguistics: ACL 2023
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Anna Rogers, Jordan Boyd-Graber, Naoaki Okazaki
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
6589–6598
Language:
URL:
https://aclanthology.org/2023.findings-acl.412
DOI:
10.18653/v1/2023.findings-acl.412
Bibkey:
Cite (ACL):
Rebecca Knowles and Samuel Larkin. 2023. Long to reign over us: A Case Study of Machine Translation and a New Monarch. In Findings of the Association for Computational Linguistics: ACL 2023, pages 6589–6598, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
Long to reign over us: A Case Study of Machine Translation and a New Monarch (Knowles & Larkin, Findings 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.findings-acl.412.pdf