Love, Anger, Sadness, or Just a Rating? Gender Assignment in Human and LLM Translations of Amazon Reviews

Shushen Manakhimova, Ekaterina Lapshinova-Koltunski, Khushi Pitroda, Maja Popović


Abstract
We investigate whether product ratings and source-text emotions are associated with first-person gender choices in English-to-Russian and English-to-Croatian translations by professional translators, students, and three LLMs (GPT-4o mini, Llama, and Mistral). We score love, sadness, and anger in the source reviews with a RoBERTa classifier fine-tuned on GoEmotions and fit logistic mixed-effects models of feminine versus masculine forms, accounting for product category, translator group, and repeated translations of the same review. Reviews with high ratings and reviews written in more positive language receive feminine forms more often in both languages. All emotion estimates point in the directions gender stereotypes predict, love and sadness toward feminine forms and anger toward masculine ones, but only love in Russian is statistically significant. We find evidence that emotion-gender associations vary across translator groups in Russian, but no clear evidence of such variation in Croatian.
Anthology ID:
2026.gebnlp-1.10
Volume:
Proceedings of the 7th Workshop on Gender Bias in Natural Language Processing (GeBNLP)
Month:
November
Year:
2026
Address:
Hengqin, China (remote)
Editors:
Agnieszka Faleńska, Christine Basta, Marta Costa-jussà, Karolina Stańczak, Debora Nozza, Giuseppe Attanasio, Vera Neplenbroek, Christian Hardmeier
Venues:
GeBNLP | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
145–156
Language:
URL:
https://aclanthology.org/2026.gebnlp-1.10/
DOI:
Bibkey:
Cite (ACL):
Shushen Manakhimova, Ekaterina Lapshinova-Koltunski, Khushi Pitroda, and Maja Popović. 2026. Love, Anger, Sadness, or Just a Rating? Gender Assignment in Human and LLM Translations of Amazon Reviews. In Proceedings of the 7th Workshop on Gender Bias in Natural Language Processing (GeBNLP), pages 145–156, Hengqin, China (remote). Association for Computational Linguistics.
Cite (Informal):
Love, Anger, Sadness, or Just a Rating? Gender Assignment in Human and LLM Translations of Amazon Reviews (Manakhimova et al., GeBNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.gebnlp-1.10.pdf
Sources:
 2026.gebnlp-1.10.sources.zip