On the Difficulty of Translating Free-Order Case-Marking Languages

Arianna Bisazza, Ahmet Üstün, Stephan Sportel


Abstract
Identifying factors that make certain languages harder to model than others is essential to reach language equality in future Natural Language Processing technologies. Free-order case-marking languages, such as Russian, Latin, or Tamil, have proved more challenging than fixed-order languages for the tasks of syntactic parsing and subject-verb agreement prediction. In this work, we investigate whether this class of languages is also more difficult to translate by state-of-the-art Neural Machine Translation (NMT) models. Using a variety of synthetic languages and a newly introduced translation challenge set, we find that word order flexibility in the source language only leads to a very small loss of NMT quality, even though the core verb arguments become impossible to disambiguate in sentences without semantic cues. The latter issue is indeed solved by the addition of case marking. However, in medium- and low-resource settings, the overall NMT quality of fixed-order languages remains unmatched.
Anthology ID:
2021.tacl-1.73
Volume:
Transactions of the Association for Computational Linguistics, Volume 9
Month:
Year:
2021
Address:
Cambridge, MA
Editors:
Brian Roark, Ani Nenkova
Venue:
TACL
SIG:
Publisher:
MIT Press
Note:
Pages:
1233–1248
Language:
URL:
https://aclanthology.org/2021.tacl-1.73
DOI:
10.1162/tacl_a_00424
Bibkey:
Cite (ACL):
Arianna Bisazza, Ahmet Üstün, and Stephan Sportel. 2021. On the Difficulty of Translating Free-Order Case-Marking Languages. Transactions of the Association for Computational Linguistics, 9:1233–1248.
Cite (Informal):
On the Difficulty of Translating Free-Order Case-Marking Languages (Bisazza et al., TACL 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.tacl-1.73.pdf
Video:
 https://aclanthology.org/2021.tacl-1.73.mp4