ALTSTEER: Selective Safety Steering for Moving Beyond Hard Refusals to Constructive Alternatives

Hoejoon Kwon, Byeonggeuk Lim, Kahyeon Kim, YoungBin Kim


Abstract
Safety alignment is essential for deploying large language models, requiring systems to prevent harmful compliance while preserving helpfulness on benign requests. Activation steering offers a training-free inference-time approach to safety control, but effective safety steering requires addressing two coupled questions: when to intervene and how generation should be shaped after intervention. However, existing safety steering methods remain limited along both dimensions, as their triggering mechanisms can be unstable across domains and refusal-oriented steering often yields rigid refusals rather than constructive safe guidance. To address these limitations, we propose ALTSTEER, an inference-time framework that couples selective intervention with refusal-anchored constructive redirection within a single inference pass. ALTSTEER uses an internal refusal-relevant signal to decide when to steer, and applies staged steering to shift generation from refusal-oriented control toward constructive alternatives. Evaluations on Llama-3.1 and Qwen2.5 show that ALTSTEER preserves benign utility while improving constructive safe-completion behavior, especially on models that otherwise tend to produce short refusals for harmful requests.
Anthology ID:
2026.emnlp-main.839
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
19455–19473
Language:
URL:
https://aclanthology.org/2026.emnlp-main.839/
DOI:
Bibkey:
Cite (ACL):
Hoejoon Kwon, Byeonggeuk Lim, Kahyeon Kim, and YoungBin Kim. 2026. ALTSTEER: Selective Safety Steering for Moving Beyond Hard Refusals to Constructive Alternatives. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 19455–19473, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
ALTSTEER: Selective Safety Steering for Moving Beyond Hard Refusals to Constructive Alternatives (Kwon et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.839.pdf