Metric for Automatic Machine Translation Evaluation based on Universal Sentence Representations

Hiroki Shimanaka, Tomoyuki Kajiwara, Mamoru Komachi


Abstract
Sentence representations can capture a wide range of information that cannot be captured by local features based on character or word N-grams. This paper examines the usefulness of universal sentence representations for evaluating the quality of machine translation. Al-though it is difficult to train sentence representations using small-scale translation datasets with manual evaluation, sentence representations trained from large-scale data in other tasks can improve the automatic evaluation of machine translation. Experimental results of the WMT-2016 dataset show that the proposed method achieves state-of-the-art performance with sentence representation features only.
Anthology ID:
N18-4015
Volume:
Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Student Research Workshop
Month:
June
Year:
2018
Address:
New Orleans, Louisiana, USA
Editors:
Silvio Ricardo Cordeiro, Shereen Oraby, Umashanthi Pavalanathan, Kyeongmin Rim
Venue:
NAACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
106–111
Language:
URL:
https://aclanthology.org/N18-4015
DOI:
10.18653/v1/N18-4015
Bibkey:
Cite (ACL):
Hiroki Shimanaka, Tomoyuki Kajiwara, and Mamoru Komachi. 2018. Metric for Automatic Machine Translation Evaluation based on Universal Sentence Representations. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Student Research Workshop, pages 106–111, New Orleans, Louisiana, USA. Association for Computational Linguistics.
Cite (Informal):
Metric for Automatic Machine Translation Evaluation based on Universal Sentence Representations (Shimanaka et al., NAACL 2018)
Copy Citation:
PDF:
https://aclanthology.org/N18-4015.pdf