Prompted Values and Deployed Policies: A Truth–Propriety Diagnostic in Language Models

Ziyuan Feng, Ajian Liu, Hui Ma, Yanyan Liang


Abstract
Prompting a language model to endorse a value does not by itself establish how that value is deployed when responses require tradeoffs. We study this gap in truth–propriety dilemmas, where direct truth-telling can conflict with tact, face-saving, deference, or role-sensitive restraint. We introduce Truth–Propriety Alignment (TPA), a 600-prompt diagnostic benchmark over 100 scenario groups, and conduct a single-model diagnostic evaluation of Qwen2.5-7B-Instruct under deterministic decoding. The model remains predominantly truth-oriented, but trigger-assigned scenario groups differ sharply in how residual responses are distributed. Because value triggers are fixed within scenario groups, we interpret this pattern as trigger-associated residual composition rather than a causal trigger effect. A small semantic audit shows that compatible residuals are mixed: they include substantive reframings but also tonal and lexical tracking. Finally, a hidden-state probe is nearly matched by an exact-prompt BoW baseline, and deleting the explicit value-trigger sentence does not reduce BoW performance, indicating that behavioral-label predictability is distributed across the prompt surface. We therefore frame TPA as a diagnostic audit of prompt intent, observed behavior, scenario/trigger priors, annotation boundaries, and probe evidence, rather than as evidence for prompt-independent value representations.
Anthology ID:
2026.findings-emnlp.1165
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
24673–24686
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.1165/
DOI:
Bibkey:
Cite (ACL):
Ziyuan Feng, Ajian Liu, Hui Ma, and Yanyan Liang. 2026. Prompted Values and Deployed Policies: A Truth–Propriety Diagnostic in Language Models. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 24673–24686, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Prompted Values and Deployed Policies: A Truth–Propriety Diagnostic in Language Models (Feng et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.1165.pdf