Optimizing Machine Translation through Prompt Engineering: An Investigation into ChatGPT’s Customizability

Masaru Yamada


Abstract
This paper explores the influence of integrating the purpose of the translation and the target audience into prompts on the quality of translations produced by ChatGPT. Drawing on previous translation studies, industry practices, and ISO standards, the research underscores the significance of the pre-production phase in the translation process. The study reveals that the inclusion of suitable prompts in large-scale language models like ChatGPT can yield flexible translations, a feat yet to be realized by conventional Ma-chine Translation (MT). The research scrutinizes the changes in translation quality when prompts are used to generate translations that meet specific conditions. The evaluation is conducted from a practicing translator’s viewpoint, both subjectively and qualitatively, supplemented by the use of OpenAI’s word embedding API for cosine similarity calculations. The findings suggest that the integration of the purpose and target audience into prompts can indeed modify the generated translations, generally enhancing the translation quality by industry standards. The study also demonstrates the practical application of the “good translation” concept, particularly in the context of marketing documents and culturally dependent idioms.
Anthology ID:
2023.mtsummit-users.19
Volume:
Proceedings of Machine Translation Summit XIX, Vol. 2: Users Track
Month:
September
Year:
2023
Address:
Macau SAR, China
Editors:
Masaru Yamada, Felix do Carmo
Venue:
MTSummit
SIG:
Publisher:
Asia-Pacific Association for Machine Translation
Note:
Pages:
195–204
Language:
URL:
https://aclanthology.org/2023.mtsummit-users.19
DOI:
Bibkey:
Cite (ACL):
Masaru Yamada. 2023. Optimizing Machine Translation through Prompt Engineering: An Investigation into ChatGPT’s Customizability. In Proceedings of Machine Translation Summit XIX, Vol. 2: Users Track, pages 195–204, Macau SAR, China. Asia-Pacific Association for Machine Translation.
Cite (Informal):
Optimizing Machine Translation through Prompt Engineering: An Investigation into ChatGPT’s Customizability (Yamada, MTSummit 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.mtsummit-users.19.pdf