Prompting Large Language Models for Idiomatic Translation

Antonio Castaldo, Johanna Monti


Abstract
Large Language Models (LLMs) have demonstrated impressive performance in translating content across different languages and genres. Yet, their potential in the creative aspects of machine translation has not been fully explored. In this paper, we seek to identify the strengths and weaknesses inherent in different LLMs when applied to one of the most prominent features of creative works: the translation of idiomatic expressions. We present an overview of their performance in the ENIT language pair, a context characterized by an evident lack of bilingual data tailored for idiomatic translation. Lastly, we investigate the impact of prompt design on the quality of machine translation, drawing on recent findings which indicate a substantial variation in the performance of LLMs depending on the prompts utilized.
Anthology ID:
2024.ctt-1.4
Volume:
Proceedings of the 1st Workshop on Creative-text Translation and Technology
Month:
June
Year:
2024
Address:
Sheffield, United Kingdom
Editors:
Bram Vanroy, Marie-Aude Lefer, Lieve Macken, Paola Ruffo
Venues:
CTT | WS
SIG:
Publisher:
European Association for Machine Translation
Note:
Pages:
32–39
Language:
URL:
https://aclanthology.org/2024.ctt-1.4
DOI:
Bibkey:
Cite (ACL):
Antonio Castaldo and Johanna Monti. 2024. Prompting Large Language Models for Idiomatic Translation. In Proceedings of the 1st Workshop on Creative-text Translation and Technology, pages 32–39, Sheffield, United Kingdom. European Association for Machine Translation.
Cite (Informal):
Prompting Large Language Models for Idiomatic Translation (Castaldo & Monti, CTT-WS 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.ctt-1.4.pdf