Analysing Mistranslation of Emotions in Multilingual Tweets by Online MT Tools

Hadeel Saadany, Constantin Orasan, Rocio Caro Quintana, Felix Do Carmo, Leonardo Zilio


Abstract
It is common for websites that contain User-Generated Text (UGT) to provide an automatic translation option to reach out to their linguistically diverse users. In such scenarios, the process of translating the users’ emotions is entirely automatic with no human intervention, neither for post-editing, nor for accuracy checking. In this paper, we assess whether automatic translation tools can be a successful real-life utility in transferring emotion in multilingual tweets. Our analysis shows that the mistranslation of the source tweet can lead to critical errors where the emotion is either completely lost or flipped to an opposite sentiment. We identify linguistic phenomena specific to Twitter data which pose a challenge in translation of emotions and show how frequent these features are in different language pairs. We also show that commonly-used quality metrics can lend false confidence in the performance of online MT tools specifically when the source emotion is distorted in telegraphic messages such as tweets.
Anthology ID:
2023.eamt-1.27
Volume:
Proceedings of the 24th Annual Conference of the European Association for Machine Translation
Month:
June
Year:
2023
Address:
Tampere, Finland
Editors:
Mary Nurminen, Judith Brenner, Maarit Koponen, Sirkku Latomaa, Mikhail Mikhailov, Frederike Schierl, Tharindu Ranasinghe, Eva Vanmassenhove, Sergi Alvarez Vidal, Nora Aranberri, Mara Nunziatini, Carla Parra Escartín, Mikel Forcada, Maja Popovic, Carolina Scarton, Helena Moniz
Venue:
EAMT
SIG:
Publisher:
European Association for Machine Translation
Note:
Pages:
275–284
Language:
URL:
https://aclanthology.org/2023.eamt-1.27
DOI:
Bibkey:
Cite (ACL):
Hadeel Saadany, Constantin Orasan, Rocio Caro Quintana, Felix Do Carmo, and Leonardo Zilio. 2023. Analysing Mistranslation of Emotions in Multilingual Tweets by Online MT Tools. In Proceedings of the 24th Annual Conference of the European Association for Machine Translation, pages 275–284, Tampere, Finland. European Association for Machine Translation.
Cite (Informal):
Analysing Mistranslation of Emotions in Multilingual Tweets by Online MT Tools (Saadany et al., EAMT 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.eamt-1.27.pdf