Steer on Rubrics: Auditable Steering of Schwartz Values in Language Models

Zichen Xu, Geng Zhao, Aoxiang Qin, Li Zhou, Benyou Wang


Abstract
Controlling the basic human values expressed by large language models (LLMs) has attracted growing attention in the mechanistic interpretability community. Recent work has made substantial attempts to steer such values through vector arithmetic or causal attribution over internal states. However, because values are complex social constructs, their mechanistic controllability still faces a major unresolved challenge: the auditability bottleneck, which makes it difficult to construct natural-language corpora that precisely capture value realization for mechanistic analysis. To address this challenge, we propose VALUEAUDITOR, a measurement-first framework that makes values behaviorally targetable before they are representationally steered. It operationalizes each value through grouped, theory-grounded response rubrics, derives graded supervision from same-scenario response contrasts, and performs inference-time steering through token-level sparse features that retain local cues of value expression. Experimental results show that VALUEAUDITOR significantly outperforms cutting-edge baseline methods on value steering benchmarks, while demonstrating robust control across values and scenarios with minimal trade-offs in response clarity. The code is publicly available at https://github.com/ZichenX/Steer-On-Rubrics
Anthology ID:
2026.emnlp-main.2147
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
48807–48838
Language:
URL:
https://aclanthology.org/2026.emnlp-main.2147/
DOI:
Bibkey:
Cite (ACL):
Zichen Xu, Geng Zhao, Aoxiang Qin, Li Zhou, and Benyou Wang. 2026. Steer on Rubrics: Auditable Steering of Schwartz Values in Language Models. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 48807–48838, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Steer on Rubrics: Auditable Steering of Schwartz Values in Language Models (Xu et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.2147.pdf