A Parallel Evaluation Data Set of Software Documentation with Document Structure Annotation

Bianka Buschbeck, Miriam Exel


Abstract
This paper accompanies the software documentation data set for machine translation, a parallel evaluation data set of data originating from the SAP Help Portal, that we released to the machine translation community for research purposes. It offers the possibility to tune and evaluate machine translation systems in the domain of corporate software documentation and contributes to the availability of a wider range of evaluation scenarios. The data set comprises of the language pairs English to Hindi, Indonesian, Malay and Thai, and thus also increases the test coverage for the many low-resource language pairs. Unlike most evaluation data sets that consist of plain parallel text, the segments in this data set come with additional metadata that describes structural information of the document context. We provide insights into the origin and creation, the particularities and characteristics of the data set as well as machine translation results.
Anthology ID:
2020.wat-1.20
Volume:
Proceedings of the 7th Workshop on Asian Translation
Month:
December
Year:
2020
Address:
Suzhou, China
Editors:
Toshiaki Nakazawa, Hideki Nakayama, Chenchen Ding, Raj Dabre, Anoop Kunchukuttan, Win Pa Pa, Ondřej Bojar, Shantipriya Parida, Isao Goto, Hidaya Mino, Hiroshi Manabe, Katsuhito Sudoh, Sadao Kurohashi, Pushpak Bhattacharyya
Venue:
WAT
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
160–169
Language:
URL:
https://aclanthology.org/2020.wat-1.20
DOI:
Bibkey:
Cite (ACL):
Bianka Buschbeck and Miriam Exel. 2020. A Parallel Evaluation Data Set of Software Documentation with Document Structure Annotation. In Proceedings of the 7th Workshop on Asian Translation, pages 160–169, Suzhou, China. Association for Computational Linguistics.
Cite (Informal):
A Parallel Evaluation Data Set of Software Documentation with Document Structure Annotation (Buschbeck & Exel, WAT 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.wat-1.20.pdf
Code
 SAP/software-documentation-data-set-for-machine-translation