Context-Aware Neural Machine Translation Decoding

Eva Martínez Garcia, Carles Creus, Cristina España-Bonet


Abstract
This work presents a decoding architecture that fuses the information from a neural translation model and the context semantics enclosed in a semantic space language model based on word embeddings. The method extends the beam search decoding process and therefore can be applied to any neural machine translation framework. With this, we sidestep two drawbacks of current document-level systems: (i) we do not modify the training process so there is no increment in training time, and (ii) we do not require document-level an-notated data. We analyze the impact of the fusion system approach and its parameters on the final translation quality for English–Spanish. We obtain consistent and statistically significant improvements in terms of BLEU and METEOR and we observe how the fused systems are able to handle synonyms to propose more adequate translations as well as help the system to disambiguate among several translation candidates for a word.
Anthology ID:
D19-6502
Volume:
Proceedings of the Fourth Workshop on Discourse in Machine Translation (DiscoMT 2019)
Month:
November
Year:
2019
Address:
Hong Kong, China
Venue:
DiscoMT
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
13–23
Language:
URL:
https://aclanthology.org/D19-6502
DOI:
10.18653/v1/D19-6502
Bibkey:
Cite (ACL):
Eva Martínez Garcia, Carles Creus, and Cristina España-Bonet. 2019. Context-Aware Neural Machine Translation Decoding. In Proceedings of the Fourth Workshop on Discourse in Machine Translation (DiscoMT 2019), pages 13–23, Hong Kong, China. Association for Computational Linguistics.
Cite (Informal):
Context-Aware Neural Machine Translation Decoding (Martínez Garcia et al., DiscoMT 2019)
Copy Citation:
PDF:
https://aclanthology.org/D19-6502.pdf