LLMs Infer Cultural Context but Fail to Apply It When Responding

Yisong Miao, Jian Zhu, Vered Shwartz


Abstract
Recent work has shown that LLMs overrepresent dominant cultures, particularly Western ones, while marginalizing others. We investigate whether this affects models’ ability to generate culturally adapted responses by evaluating their use of local measurement units based on the user’s perceived cultural background. We introduce Cultural and Pragmatic Response Inference (CAPRI), a dataset of conversations with varying levels of cultural cues. Experiments with state-of-the-art LLMs show that models can infer cultural background and recall relevant conventions, but often fail to utilize the information to adapt their answers to the relevant cultural conventions, unless explicitly prompted to perform the tasks sequentially. We further evaluate adaptation to the interpretation of time and quantity expressions, two subjective language grounding dimensions that are affected by culture. We find that models increasingly adapt their answers as cultural cues accumulate, but their priors are not culture-neutral, sometimes aligning with the model’s country of origin. Overall, CAPRI provides a resource for future research aimed at narrowing the gap between cultural knowledge and culturally adaptive language generation.
Anthology ID:
2026.emnlp-main.1943
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
44208–44233
Language:
URL:
https://aclanthology.org/2026.emnlp-main.1943/
DOI:
Bibkey:
Cite (ACL):
Yisong Miao, Jian Zhu, and Vered Shwartz. 2026. LLMs Infer Cultural Context but Fail to Apply It When Responding. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 44208–44233, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
LLMs Infer Cultural Context but Fail to Apply It When Responding (Miao et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.1943.pdf