Hee-Dong Kim
Author directory2026
Conditioning Activation Interventions on Evolving Reasoning States in Large Language Models
Tae-Won Kim | Hee-Dong Kim | Jumin Han | Seong-Whan Lee
Findings of the Association for Computational Linguistics: EMNLP 2026
Tae-Won Kim | Hee-Dong Kim | Jumin Han | Seong-Whan Lee
Findings of the Association for Computational Linguistics: EMNLP 2026
Activation steering controls language model behavior at inference time by injecting behavior-relevant directions into internal representations. In the standard steering interface, a steering direction is estimated once before generation and then applied throughout decoding. However, during multi-step reasoning, the model’s internal state shifts continuously as reasoning progresses, while standard steering continues to apply the same fixed direction across these changing states. This creates a mismatch between the model’s evolving reasoning state and the static intervention applied to it. To address this mismatch, we introduce State-Conditioned Steering (SCS), which recomputes the additive update itself from the hidden states encountered during generation while keeping the same additive intervention interface. Rather than adapting when or how strongly to intervene, SCS re-estimates the update from intermediate reasoning states as generation proceeds. In a paired comparison setting, we compare fixed and state-conditioned updates and find that predefined directions often exhibit unstable effects, while SCS yields more consistent intervention behavior across decoding steps. Across reasoning benchmarks with explicit step structure and three instruction-tuned backbones, SCS achieves larger average gains than prompting-only decoding and baseline activation steering methods.