CC-Mediation: Evaluating Large Language Models for Cross-Cultural Conflict Mediation

Suhyun Lee, Wenxuan Zhang, W. Quin Yow, Yang Deng


Abstract
Cross-cultural mediation by large language models (LLMs) requires deciding both when to intervene and how to respond in culturally grounded conflicts. Progress on this problem has been limited by the lack of (1) mediation datasets with measurable downstream effects and (2) principled metrics for evaluating intercultural stance change. To address these gaps, we introduce CC-Mediation, a cross-cultural mediation benchmark of 1,661 ten-turn dialogues grounded in the Developmental Model of Intercultural Sensitivity (DMIS), containing culturally grounded conflicts, mediation interventions, and post-intervention trajectories. We further propose two DMIS-based evaluation metrics: Trajectory AUC, which measures the persistence of intercultural improvement over time, and a signed Wasserstein-1 distance, which measures the magnitude and direction of shifts in intercultural stance. Both metrics show strong agreement with human judgment. Using CC-Mediation, we find that current LLMs have limitations on both axes: intervention timing (when) failure stems from a positional prior that ignores dialogue content, while mediation strategy (how) failure arises from a late-layer elicitation collapse rather than a knowledge deficit.
Anthology ID:
2026.findings-emnlp.1672
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
35662–35689
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.1672/
DOI:
Bibkey:
Cite (ACL):
Suhyun Lee, Wenxuan Zhang, W. Quin Yow, and Yang Deng. 2026. CC-Mediation: Evaluating Large Language Models for Cross-Cultural Conflict Mediation. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 35662–35689, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
CC-Mediation: Evaluating Large Language Models for Cross-Cultural Conflict Mediation (Lee et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.1672.pdf