KpopMT: Translation Dataset with Terminology for Kpop Fandom

JiWoo Kim, Yunsu Kim, JinYeong Bak


Abstract
While machines learn from existing corpora, humans have the unique capability to establish and accept new language systems. This makes human form unique language systems within social groups. Aligning with this, we focus on a gap remaining in addressing translation challenges within social groups, where in-group members utilize unique terminologies. We propose KpopMT dataset, which aims to fill this gap by enabling precise terminology translation, choosing Kpop fandom as an initiative for social groups given its global popularity. Expert translators provide 1k English translations for Korean posts and comments, each annotated with specific terminology within social groups’ language systems. We evaluate existing translation systems including GPT models on KpopMT to identify their failure cases. Results show overall low scores, underscoring the challenges of reflecting group-specific terminologies and styles in translation. We make KpopMT publicly available.
Anthology ID:
2024.loresmt-1.3
Volume:
Proceedings of the The Seventh Workshop on Technologies for Machine Translation of Low-Resource Languages (LoResMT 2024)
Month:
August
Year:
2024
Address:
Bangkok, Thailand
Editors:
Atul Kr. Ojha, Chao-hong Liu, Ekaterina Vylomova, Flammie Pirinen, Jade Abbott, Jonathan Washington, Nathaniel Oco, Valentin Malykh, Varvara Logacheva, Xiaobing Zhao
Venues:
LoResMT | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
37–43
Language:
URL:
https://aclanthology.org/2024.loresmt-1.3
DOI:
Bibkey:
Cite (ACL):
JiWoo Kim, Yunsu Kim, and JinYeong Bak. 2024. KpopMT: Translation Dataset with Terminology for Kpop Fandom. In Proceedings of the The Seventh Workshop on Technologies for Machine Translation of Low-Resource Languages (LoResMT 2024), pages 37–43, Bangkok, Thailand. Association for Computational Linguistics.
Cite (Informal):
KpopMT: Translation Dataset with Terminology for Kpop Fandom (Kim et al., LoResMT-WS 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.loresmt-1.3.pdf