Treatment of Markup in Statistical Machine Translation

Mathias Müller


Abstract
We present work on handling XML markup in Statistical Machine Translation (SMT). The methods we propose can be used to effectively preserve markup (for instance inline formatting or structure) and to place markup correctly in a machine-translated segment. We evaluate our approaches with parallel data that naturally contains markup or where markup was inserted to create synthetic examples. In our experiments, hybrid reinsertion has proven the most accurate method to handle markup, while alignment masking and alignment reinsertion should be regarded as viable alternatives. We provide implementations of all the methods described and they are freely available as an open-source framework.
Anthology ID:
W17-4804
Volume:
Proceedings of the Third Workshop on Discourse in Machine Translation
Month:
September
Year:
2017
Address:
Copenhagen, Denmark
Editors:
Bonnie Webber, Andrei Popescu-Belis, Jörg Tiedemann
Venue:
DiscoMT
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
36–46
Language:
URL:
https://aclanthology.org/W17-4804
DOI:
10.18653/v1/W17-4804
Bibkey:
Cite (ACL):
Mathias Müller. 2017. Treatment of Markup in Statistical Machine Translation. In Proceedings of the Third Workshop on Discourse in Machine Translation, pages 36–46, Copenhagen, Denmark. Association for Computational Linguistics.
Cite (Informal):
Treatment of Markup in Statistical Machine Translation (Müller, DiscoMT 2017)
Copy Citation:
PDF:
https://aclanthology.org/W17-4804.pdf