On The Real-world Performance of Machine Translation: Exploring Social Media Post-authors’ Perspectives

Ananya Gupta, Jae Takeuchi, Bart Knijnenburg


Abstract
Many social networking sites (SNS) offer machine translation of posts in an effort to increase understanding, engagement, and connectivity between users across language barriers. However, the translations of these posts are still not 100% accurate and can be a cause of misunderstandings that can harm post-authors’ professional or personal relationships. An exacerbating factor is on most SNS, authors cannot view the translation of their own posts, nor make corrections to inaccurate translations. This paper reports findings from a survey (N = 189) and an interview (N = 15) to explore users’ concerns regarding this automatic form of machine translation. Our findings show that users are concerned about potential inaccuracies in the meaning of the translations of their posts, and would thus appreciate being able to view and potentially correct such translations. Additionally, we found that when users write posts in their native language, they write them for specific audiences, so they do not always want them translated. This underscores the urgency of providing users with more control over the translation of their posts.
Anthology ID:
2023.trustnlp-1.26
Volume:
Proceedings of the 3rd Workshop on Trustworthy Natural Language Processing (TrustNLP 2023)
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Anaelia Ovalle, Kai-Wei Chang, Ninareh Mehrabi, Yada Pruksachatkun, Aram Galystan, Jwala Dhamala, Apurv Verma, Trista Cao, Anoop Kumar, Rahul Gupta
Venue:
TrustNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
302–310
Language:
URL:
https://aclanthology.org/2023.trustnlp-1.26
DOI:
10.18653/v1/2023.trustnlp-1.26
Bibkey:
Cite (ACL):
Ananya Gupta, Jae Takeuchi, and Bart Knijnenburg. 2023. On The Real-world Performance of Machine Translation: Exploring Social Media Post-authors’ Perspectives. In Proceedings of the 3rd Workshop on Trustworthy Natural Language Processing (TrustNLP 2023), pages 302–310, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
On The Real-world Performance of Machine Translation: Exploring Social Media Post-authors’ Perspectives (Gupta et al., TrustNLP 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.trustnlp-1.26.pdf
Supplementary material:
 2023.trustnlp-1.26.SupplementaryMaterial.zip