Cost Weighting for Neural Machine Translation Domain Adaptation

Boxing Chen, Colin Cherry, George Foster, Samuel Larkin


Abstract
In this paper, we propose a new domain adaptation technique for neural machine translation called cost weighting, which is appropriate for adaptation scenarios in which a small in-domain data set and a large general-domain data set are available. Cost weighting incorporates a domain classifier into the neural machine translation training algorithm, using features derived from the encoder representation in order to distinguish in-domain from out-of-domain data. Classifier probabilities are used to weight sentences according to their domain similarity when updating the parameters of the neural translation model. We compare cost weighting to two traditional domain adaptation techniques developed for statistical machine translation: data selection and sub-corpus weighting. Experiments on two large-data tasks show that both the traditional techniques and our novel proposal lead to significant gains, with cost weighting outperforming the traditional methods.
Anthology ID:
W17-3205
Volume:
Proceedings of the First Workshop on Neural Machine Translation
Month:
August
Year:
2017
Address:
Vancouver
Editors:
Thang Luong, Alexandra Birch, Graham Neubig, Andrew Finch
Venue:
NGT
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
40–46
Language:
URL:
https://aclanthology.org/W17-3205
DOI:
10.18653/v1/W17-3205
Bibkey:
Cite (ACL):
Boxing Chen, Colin Cherry, George Foster, and Samuel Larkin. 2017. Cost Weighting for Neural Machine Translation Domain Adaptation. In Proceedings of the First Workshop on Neural Machine Translation, pages 40–46, Vancouver. Association for Computational Linguistics.
Cite (Informal):
Cost Weighting for Neural Machine Translation Domain Adaptation (Chen et al., NGT 2017)
Copy Citation:
PDF:
https://aclanthology.org/W17-3205.pdf