Xianru Chen
Author directory2026
MSQA: A Natively Sourced Multilingual and Multicultural SimpleQA Benchmark
Yukai Huang | Xianru Chen | Mingxiang Chen | Xinping Lei | Fangbing Deng | Jin Chen | Jiaheng Liu | Ge Zhang | Wenhao Huang
Findings of the Association for Computational Linguistics: EMNLP 2026
Yukai Huang | Xianru Chen | Mingxiang Chen | Xinping Lei | Fangbing Deng | Jin Chen | Jiaheng Liu | Ge Zhang | Wenhao Huang
Findings of the Association for Computational Linguistics: EMNLP 2026
Multilingual fluency often invites a stronger assumption: a model that can speak a user’s language must also understand the culture encoded by that language. We call this the Illusion of Cultural Alignment. To test this assumption directly, we introduce MMC-QA, a benchmark of 1,086 natively sourced questions across 11 language groups, five cultural dimensions, and three difficulty tiers. Unlike translated benchmarks, MMC-QA targets locally grounded knowledge and reduces shortcuts from English-centric cross-lingual transfer. Evaluating 15 LLMs, we find substantial cultural degradation and a pronounced Locality Effect: cultural competence tracks pre-training exposure more closely than general reasoning ability. We further show that common inference-time remedies do not dissolve the illusion. Models remain overconfident on unfamiliar cultural questions, repeated sampling yields unstable rather than reliable correctness, and retrieval augmentation helps unevenly on long-tail facts. These findings indicate that cultural alignment cannot be inferred from multilingual ability alone and requires deeper intervention than calibration, sampling, or retrieval at inference time.