IRD: Steering Reasoning Models with Intent, Risk, and Decision

Kang Zhou, Guanghao Zhou, Cen Chen, Zhaoyang Liu, Ming Gao, Yaliang Li


Abstract
Large reasoning models (LRMs) are strong multi-step problem solvers, yet their long reasoning traces may gradually drift into unsafe compliance when exposed to harmful or adversarial prompts. Existing safety alignment methods can reduce harmful outputs; however, they often rely on broad refusal or supervision over full safe reasoning traces, which may weaken the reasoning behavior that makes LRMs useful. We introduce Intent–Risk–Decision (IRD), a lightweight prefix-tuning method that steers only the beginning of the reasoning trace: the model first emits a prompt-intent tag, a risk statement, and a compliance decision, and then continues under its original reasoning policy. Across three LRMs and evaluations covering harmfulness, jailbreak robustness, over-refusal, and reasoning ability, IRD substantially reduces unsafe outputs while preserving reasoning performance. In particular, IRD lowers average harmfulness to 1.2–7.4% across the evaluated backbones and keeps near-lossless reasoning performance, %within 0.2 average points of the base models, showing that targeted early steering can improve safety without supervising complete safe traces or full model fine-tuning. Code and data are available at https://github.com/ReXT9527/IRD.
Anthology ID:
2026.emnlp-main.613
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
14103–14121
Language:
URL:
https://aclanthology.org/2026.emnlp-main.613/
DOI:
Bibkey:
Cite (ACL):
Kang Zhou, Guanghao Zhou, Cen Chen, Zhaoyang Liu, Ming Gao, and Yaliang Li. 2026. IRD: Steering Reasoning Models with Intent, Risk, and Decision. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 14103–14121, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
IRD: Steering Reasoning Models with Intent, Risk, and Decision (Zhou et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.613.pdf