TMU NMT System with Japanese BART for the Patent task of WAT 2021

Hwichan Kim, Mamoru Komachi


Abstract
In this paper, we introduce our TMU Neural Machine Translation (NMT) system submitted for the Patent task (Korean Japanese and English Japanese) of 8th Workshop on Asian Translation (Nakazawa et al., 2021). Recently, several studies proposed pre-trained encoder-decoder models using monolingual data. One of the pre-trained models, BART (Lewis et al., 2020), was shown to improve translation accuracy via fine-tuning with bilingual data. However, they experimented only Romanian!English translation using English BART. In this paper, we examine the effectiveness of Japanese BART using Japan Patent Office Corpus 2.0. Our experiments indicate that Japanese BART can also improve translation accuracy in both Korean Japanese and English Japanese translations.
Anthology ID:
2021.wat-1.13
Volume:
Proceedings of the 8th Workshop on Asian Translation (WAT2021)
Month:
August
Year:
2021
Address:
Online
Editors:
Toshiaki Nakazawa, Hideki Nakayama, Isao Goto, Hideya Mino, Chenchen Ding, Raj Dabre, Anoop Kunchukuttan, Shohei Higashiyama, Hiroshi Manabe, Win Pa Pa, Shantipriya Parida, Ondřej Bojar, Chenhui Chu, Akiko Eriguchi, Kaori Abe, Yusuke Oda, Katsuhito Sudoh, Sadao Kurohashi, Pushpak Bhattacharyya
Venue:
WAT
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
133–137
Language:
URL:
https://aclanthology.org/2021.wat-1.13
DOI:
10.18653/v1/2021.wat-1.13
Bibkey:
Cite (ACL):
Hwichan Kim and Mamoru Komachi. 2021. TMU NMT System with Japanese BART for the Patent task of WAT 2021. In Proceedings of the 8th Workshop on Asian Translation (WAT2021), pages 133–137, Online. Association for Computational Linguistics.
Cite (Informal):
TMU NMT System with Japanese BART for the Patent task of WAT 2021 (Kim & Komachi, WAT 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.wat-1.13.pdf