Like Chalk and Cheese? On the Effects of Translationese in MT Training

Samuel Larkin, Michel Simard, Rebecca Knowles


Abstract
We revisit the topic of translation direction in the data used for training neural machine translation systems and focusing on a real-world scenario with known translation direction and imbalances in translation direction: the Canadian Hansard. According to automatic metrics and we observe that using parallel data that was produced in the “matching” translation direction (Authentic source and translationese target) improves translation quality. In cases of data imbalance in terms of translation direction and we find that tagging of translation direction can close the performance gap. We perform a human evaluation that differs slightly from the automatic metrics and but nevertheless confirms that for this French-English dataset that is known to contain high-quality translations and authentic or tagged mixed source improves over translationese source for training.
Anthology ID:
2021.mtsummit-research.9
Volume:
Proceedings of Machine Translation Summit XVIII: Research Track
Month:
August
Year:
2021
Address:
Virtual
Editors:
Kevin Duh, Francisco Guzmán
Venue:
MTSummit
SIG:
Publisher:
Association for Machine Translation in the Americas
Note:
Pages:
103–113
Language:
URL:
https://aclanthology.org/2021.mtsummit-research.9
DOI:
Bibkey:
Cite (ACL):
Samuel Larkin, Michel Simard, and Rebecca Knowles. 2021. Like Chalk and Cheese? On the Effects of Translationese in MT Training. In Proceedings of Machine Translation Summit XVIII: Research Track, pages 103–113, Virtual. Association for Machine Translation in the Americas.
Cite (Informal):
Like Chalk and Cheese? On the Effects of Translationese in MT Training (Larkin et al., MTSummit 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.mtsummit-research.9.pdf