NICT’s Neural Machine Translation Systems for the WAT21 Restricted Translation Task

Zuchao Li, Masao Utiyama, Eiichiro Sumita, Hai Zhao


Abstract
This paper describes our system (Team ID: nictrb) for participating in the WAT’21 restricted machine translation task. In our submitted system, we designed a new training approach for restricted machine translation. By sampling from the translation target, we can solve the problem that ordinary training data does not have a restricted vocabulary. With the further help of constrained decoding in the inference phase, we achieved better results than the baseline, confirming the effectiveness of our solution. In addition, we also tried the vanilla and sparse Transformer as the backbone network of the model, as well as model ensembling, which further improved the final translation performance.
Anthology ID:
2021.wat-1.4
Volume:
Proceedings of the 8th Workshop on Asian Translation (WAT2021)
Month:
August
Year:
2021
Address:
Online
Editors:
Toshiaki Nakazawa, Hideki Nakayama, Isao Goto, Hideya Mino, Chenchen Ding, Raj Dabre, Anoop Kunchukuttan, Shohei Higashiyama, Hiroshi Manabe, Win Pa Pa, Shantipriya Parida, Ondřej Bojar, Chenhui Chu, Akiko Eriguchi, Kaori Abe, Yusuke Oda, Katsuhito Sudoh, Sadao Kurohashi, Pushpak Bhattacharyya
Venue:
WAT
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
62–67
Language:
URL:
https://aclanthology.org/2021.wat-1.4
DOI:
10.18653/v1/2021.wat-1.4
Bibkey:
Cite (ACL):
Zuchao Li, Masao Utiyama, Eiichiro Sumita, and Hai Zhao. 2021. NICT’s Neural Machine Translation Systems for the WAT21 Restricted Translation Task. In Proceedings of the 8th Workshop on Asian Translation (WAT2021), pages 62–67, Online. Association for Computational Linguistics.
Cite (Informal):
NICT’s Neural Machine Translation Systems for the WAT21 Restricted Translation Task (Li et al., WAT 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.wat-1.4.pdf