An Operation Sequence Model for Explainable Neural Machine Translation

Felix Stahlberg, Danielle Saunders, Bill Byrne


Abstract
We propose to achieve explainable neural machine translation (NMT) by changing the output representation to explain itself. We present a novel approach to NMT which generates the target sentence by monotonically walking through the source sentence. Word reordering is modeled by operations which allow setting markers in the target sentence and move a target-side write head between those markers. In contrast to many modern neural models, our system emits explicit word alignment information which is often crucial to practical machine translation as it improves explainability. Our technique can outperform a plain text system in terms of BLEU score under the recent Transformer architecture on Japanese-English and Portuguese-English, and is within 0.5 BLEU difference on Spanish-English.
Anthology ID:
W18-5420
Volume:
Proceedings of the 2018 EMNLP Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP
Month:
November
Year:
2018
Address:
Brussels, Belgium
Editors:
Tal Linzen, Grzegorz Chrupała, Afra Alishahi
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
175–186
Language:
URL:
https://aclanthology.org/W18-5420
DOI:
10.18653/v1/W18-5420
Bibkey:
Cite (ACL):
Felix Stahlberg, Danielle Saunders, and Bill Byrne. 2018. An Operation Sequence Model for Explainable Neural Machine Translation. In Proceedings of the 2018 EMNLP Workshop BlackboxNLP: Analyzing and Interpreting Neural Networks for NLP, pages 175–186, Brussels, Belgium. Association for Computational Linguistics.
Cite (Informal):
An Operation Sequence Model for Explainable Neural Machine Translation (Stahlberg et al., EMNLP 2018)
Copy Citation:
PDF:
https://aclanthology.org/W18-5420.pdf
Code
 fstahlberg/ucam-scripts