Can LLMs Help Sun Wukong in his Journey to the West? A Case Study of Language Models in Video Game Localization

Xiaojing Zhao, Han Xu, Huacheng Song, Emmanuele Chersoni, Chu-Ren Huang


Abstract
Large language models (LLMs) have demonstrated increasing proficiency in general-purpose translation, yet their effectiveness in creative domains such as game localization remains underexplored. This study focuses on the role of LLMs in game localization from both linguistic quality and sociocultural adequacy through a case study of the video game Black Myth: Wukong. Results indicate that LLMs demonstrate adequate competence in accuracy and fluency, achieving performance comparable to human translators. However, limitations remain in the literal translation of culture-specific terms and offensive language. Human oversight is required to ensure nuanced cultural authenticity and sensitivity. Insights from human evaluations also suggest that current automatic metrics and the Multidimensional Quality Metrics framework may be inadequate for evaluating creative translation. Finally, varying human preferences in localization pose a learning ambiguity for LLMs to perform optimal translation strategies. The findings highlight the potential and shortcomings of LLMs to serve as collaborative tools in game localization workflows. Data are available at https://github.com/zcocozz/wukong-localization.
Anthology ID:
2025.lm4dh-1.16
Volume:
Proceedings of the First on Natural Language Processing and Language Models for Digital Humanities
Month:
September
Year:
2025
Address:
Varna, Bulgaria
Editors:
Isuri Nanomi Arachchige, Francesca Frontini, Ruslan Mitkov, Paul Rayson
Venues:
LM4DH | WS
SIG:
Publisher:
INCOMA Ltd., Shoumen, Bulgaria
Note:
Pages:
164–173
Language:
URL:
https://aclanthology.org/2025.lm4dh-1.16/
DOI:
Bibkey:
Cite (ACL):
Xiaojing Zhao, Han Xu, Huacheng Song, Emmanuele Chersoni, and Chu-Ren Huang. 2025. Can LLMs Help Sun Wukong in his Journey to the West? A Case Study of Language Models in Video Game Localization. In Proceedings of the First on Natural Language Processing and Language Models for Digital Humanities, pages 164–173, Varna, Bulgaria. INCOMA Ltd., Shoumen, Bulgaria.
Cite (Informal):
Can LLMs Help Sun Wukong in his Journey to the West? A Case Study of Language Models in Video Game Localization (Zhao et al., LM4DH 2025)
Copy Citation:
PDF:
https://aclanthology.org/2025.lm4dh-1.16.pdf