The Alignment Veto: How Safety Training Suppresses Cultural Knowledge in LLMs

Pardis Sadat Zahraei, Gokhan Tur, Dilek Hakkani-Tür, Ehsaneddin Asgari


Abstract
What happens inside a language model when alignment training conflicts with a cultural value it encodes? Across 16 MENA countries, 26 models, and 1.53M human survey responses, we find evidence that the dominant mechanism is suppression rather than erasure. When an aligned model refuses, its internal logit distribution often correlates more strongly with human survey responses than its freely generated answer. We call this the alignment veto. We distinguish suppression failures (accurate internal distributions blocked at output) from representational bias failures (the encoding itself diverges from human values), and show the two require different interventions. Generation-time interventions confirm the gate is causal, not only correlational: sweeping a refusal direction moves generated refusal from 0% to 100%, and ablating it releases the answer the model had already encoded. Native-language prompting degrades alignment quality overall and shifts refusal in framing-dependent directions. Sparse autoencoder analysis corroborated by comparisons across alignment stages identifies a candidate DPO-stage feature mediating suppression in Tulu-3-8B. The gate is real, its costs are unequal, and deciding what it should protect is not a technical question.
Anthology ID:
2026.emnlp-main.1874
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
42697–42741
Language:
URL:
https://aclanthology.org/2026.emnlp-main.1874/
DOI:
Bibkey:
Cite (ACL):
Pardis Sadat Zahraei, Gokhan Tur, Dilek Hakkani-Tür, and Ehsaneddin Asgari. 2026. The Alignment Veto: How Safety Training Suppresses Cultural Knowledge in LLMs. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 42697–42741, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
The Alignment Veto: How Safety Training Suppresses Cultural Knowledge in LLMs (Zahraei et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.1874.pdf