I Am Not Them: Persistent Outgroup Bias in Large Language Models Arising from Social Identity Persona Setting

Wenchao Dong, Assem Zhunis, Dongyoung Jeong, Hyojin Chin, Jiyoung Han, Meeyoung Cha


Abstract
This research examines how large language models internalize social identities assigned through targeted prompts. Guided by social identity theory, we investigate whether and how these identity assignments cause AI systems to differentiate between “we” (the ingroup) and “they” (the outgroup). We demonstrate that self-categorization of social identity leads to both ingroup favoritism and outgroup bias, with the latter manifesting as strongly as the former. This finding is significant given the fundamental role of outgroup bias in driving intergroup prejudice and discrimination as documented in social psychology. We further propose a strategic intervention to mitigate such bias by guiding language models to adopt the identity of the initially disfavored group. This method, validated across both political and gender domains, exposes a critical dual function of group alignment: adopting one social identity inherently alters the model’s stance toward outgroups, effectively neutralizing pre-existing biases. Our work shows that understanding human-like AI behaviors is a critical prerequisite to building more balanced and socially responsible technology.
Anthology ID:
2026.lrec-1.217
Volume:
Proceedings of the Fifteenth Language Resources and Evaluation Conference
Month:
May
Year:
2026
Address:
Palma de Mallorca, Spain
Editors:
Stelios Piperidis, Núria Bel, Henk van den Heuvel, Nancy Ide, Simon Krek, Antonio Toral
Venue:
LREC
SIG:
Publisher:
ELRA Language Resource Association
Note:
Pages:
2772–2786
Language:
External URL:
https://lrec.elra.info/lrec2026-main-217
DOI:
10.63317/2hn5gs6yh5m2
Bibkey:
Cite (ACL):
Wenchao Dong, Assem Zhunis, Dongyoung Jeong, Hyojin Chin, Jiyoung Han, and Meeyoung Cha. 2026. I Am Not Them: Persistent Outgroup Bias in Large Language Models Arising from Social Identity Persona Setting. In Proceedings of the Fifteenth Language Resources and Evaluation Conference, pages 2772–2786, Palma de Mallorca, Spain. ELRA Language Resource Association.
Cite (Informal):
I Am Not Them: Persistent Outgroup Bias in Large Language Models Arising from Social Identity Persona Setting (Dong et al., LREC 2026)
Copy Citation: