Adversarial Robustness of Activation Steering in Large Language Models

Kien Le, Thai Le


Abstract
Activation steering has become a popular training-free method to control LLMs’ behavior by injecting precomputed direction vectors into the model’s residual stream at inference time. Yet, its robustness to realistic input variation remains under-explored. We present the first systematic evaluation of activation steering robustness under adversarial text perturbations on the inputs, covering four extraction methods, three attack strategies, six personas from the Anthropic Model-Written Evaluations dataset, and five models ranging from 1.5B to 30B parameters. Attacks succeed broadly across all settings: directional robustness drops by up to 64%, post-attack confidence collapses near or below 0.25 across all methods and models, and steering strength degrades on nearly every steerable input. Layer selection is equally fragile, with the optimal layer identified by an automated method on clean inputs shifting by up to 17 positions under perturbation, a failure that compounds the vector-level breakdown. Extracting vectors from adversarially perturbed inputs partially recovers steerability for PCA and MD on mid-to-large models, but they consistently fail to locate the improved optimal layer, limiting the practical benefit of this mitigation. Together, these findings reveal that the brittleness of activation steering is structural rather than method-specific, and that current layer selection strategies are not robust enough for real-world deployment. Our code is available at https://github.com/kien206/steering-adv-robustness.
Anthology ID:
2026.findings-emnlp.1124
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
23804–23825
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.1124/
DOI:
Bibkey:
Cite (ACL):
Kien Le and Thai Le. 2026. Adversarial Robustness of Activation Steering in Large Language Models. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 23804–23825, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Adversarial Robustness of Activation Steering in Large Language Models (Le & Le, Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.1124.pdf