Cultural and Knowledge Biases in LLMs through the Lens of Entity-Aware Machine Translation

Lu Xu, Luca Moroni, Roberto Navigli


Abstract
Large Language Models (LLMs) demonstrate strong multilingual capabilities yet exhibit systematic cultural biases that affect entity-aware machine translation. While external knowledge integration improves translation accuracy, the extent of these benefits across varying degrees of cultural specificity remains unexplored. We propose a three-level cultural specificity framework: Culturally Agnostic, Culturally Sensitive, and Culturally Local, to systematically analyze how cultural context affects entity translation difficulty and the utility of external knowledge. Through experiments spanning 11 LLMs and 10 languages, we demonstrate that external knowledge provides substantially greater improvements for culturally local entities (up to 70% in m-ETA) compared to culturally agnostic ones. Our analysis reveals distinct behavioral patterns across model tiers: closed and open-weight models show synergistic improvements in both entity accuracy and overall translation quality, while open-data models struggle with instruction-following despite improved entity accuracy.
Anthology ID:
2026.lrec-1.692
Volume:
Proceedings of the Fifteenth Language Resources and Evaluation Conference
Month:
May
Year:
2026
Address:
Palma de Mallorca, Spain
Editors:
Stelios Piperidis, Núria Bel, Henk van den Heuvel, Nancy Ide, Simon Krek, Antonio Toral
Venue:
LREC
SIG:
Publisher:
ELRA Language Resource Association
Note:
Pages:
8794–8812
Language:
External URL:
https://lrec.elra.info/lrec2026-main-692
DOI:
10.63317/3jxgnspt4srr
Bibkey:
Cite (ACL):
Lu Xu, Luca Moroni, and Roberto Navigli. 2026. Cultural and Knowledge Biases in LLMs through the Lens of Entity-Aware Machine Translation. In Proceedings of the Fifteenth Language Resources and Evaluation Conference, pages 8794–8812, Palma de Mallorca, Spain. ELRA Language Resource Association.
Cite (Informal):
Cultural and Knowledge Biases in LLMs through the Lens of Entity-Aware Machine Translation (Xu et al., LREC 2026)
Copy Citation: