Counter-Stereotypic Evidence Is Not Enough: Unequal Uptake in LLMs

Jinxuan Wu, Bin Li, Xiangyang Xue


Abstract
Recent work shows that context can both amplify and mitigate social bias in LLMs. Yet a key question remains underexplored: when context provides counter-stereotypic evidence, is that evidence taken up equitably across demographic targets? Using agency–communality bias as a testbed, we introduce a sequential evaluation framework that holds total counter-evidence fixed while varying its evidence structure, adapting the bookkeeping–subtyping contrast from social cognition. Across three instruction-tuned LLMs evaluated in English, counter-evidence is taken up in explicit group-level judgement and transfers to explicit judgement about held-out individuals. The prior-category structure of this uptake, however, does not carry over to generation: communal-prior targets lose their correction advantage, absorb evidence more slowly, and the weakest uptake repeatedly appears for Asian and Hispanic female targets within our controlled target set. The tested prompt instruction and DPO fine-tuning variants yield partial improvements at prior-category level but do not reliably repair these target-level gaps. These findings show that fairness audits for context-rich LLM systems should go beyond checking whether corrective evidence is present and test whether models use that evidence equitably in downstream generation.
Anthology ID:
2026.emnlp-main.388
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
8892–8923
Language:
URL:
https://aclanthology.org/2026.emnlp-main.388/
DOI:
Bibkey:
Cite (ACL):
Jinxuan Wu, Bin Li, and Xiangyang Xue. 2026. Counter-Stereotypic Evidence Is Not Enough: Unequal Uptake in LLMs. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 8892–8923, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Counter-Stereotypic Evidence Is Not Enough: Unequal Uptake in LLMs (Wu et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.388.pdf