CultureTalk: Towards Multi-turn Cultural Competence in Large Language Models

Minzhi Li, Jiayu Han, Oleg Poliannikov, Vipul Agarwal, Dezhi Hong, Mingxian Wang


Abstract
As conversational AI systems increasingly engage users through multi-turn dialogue across diverse cultural contexts, cross-cultural competence, the ability to recognize, respect, and adapt to cultural differences, is essential for effective human-AI interaction. Existing evaluations largely rely on single-turn settings, overlooking the complexities of real-world, multi-turn conversations where cultural cues often emerge gradually. To address this gap, we introduce CultureTalk, a benchmark for evaluating multi-turn cultural reasoning in conversational AI. The dataset contains 1,741 culturally grounded dialogues derived from human-verified cultural knowledge resources and evaluates models’ ability to accumulate cultural context across turns and remain robust to topic shifts. Our evaluation reveals substantial performance gaps between single- and multi-turn settings, highlighting current models’ limitations in sustained culturally grounded context understanding. We further show that fine-tuning on augmented single-turn conversational data and inference scaling significantly improve multi-turn cultural reasoning, yielding a 64.7% relative gain in cultural knowledge entailment with a fine-tuned Qwen3-8B model.
Anthology ID:
2026.findings-emnlp.99
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
2048–2065
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.99/
DOI:
Bibkey:
Cite (ACL):
Minzhi Li, Jiayu Han, Oleg Poliannikov, Vipul Agarwal, Dezhi Hong, and Mingxian Wang. 2026. CultureTalk: Towards Multi-turn Cultural Competence in Large Language Models. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 2048–2065, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
CultureTalk: Towards Multi-turn Cultural Competence in Large Language Models (Li et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.99.pdf