Scaled Autoregressive Projection Steering (SAPS): Token-level Steering to Induce Sarcasm and Humblebrag in Text

Sharath Naganna, Ritesh Sur Chowdhury, Dipankar Srirag, Aditya Joshi


Abstract
We propose Scaled Autoregressive Projection Steering (SAPS) for generating incongruity-based figurative language from literal inputs, extending contrastive paraphrasing-based steering vectors by autoregressively recomputing projection coefficients during decoding. SAPS comprises two novel components: (A) Autoregressive Projection Steering (APS), which recomputes the projection coefficient (ct) at each decoding step t, adapting the steering signal to the evolving token distribution, and (B) a scaling coefficient 𝛼 whose effective range is layer-agnostic, enabling compact tuning of figurative intensity. Experiments across three instruction-tuned language models show that APS improves grammatical stability over fixed sentence-level steering while 𝛼 enables fine-grained figurative control, together yielding gains over prior steering methods and significantly increasing robustness to layer selection and steering strength. Cross-dataset experiments further confirm that steering directions generalize across domains. This is the first work to apply activation steering to incongruity-based figurative language generation. Our code is available at: https://github.com/SharathHN/saps-steering.
Anthology ID:
2026.findings-emnlp.1594
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
33932–33961
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.1594/
DOI:
Bibkey:
Cite (ACL):
Sharath Naganna, Ritesh Sur Chowdhury, Dipankar Srirag, and Aditya Joshi. 2026. Scaled Autoregressive Projection Steering (SAPS): Token-level Steering to Induce Sarcasm and Humblebrag in Text. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 33932–33961, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Scaled Autoregressive Projection Steering (SAPS): Token-level Steering to Induce Sarcasm and Humblebrag in Text (Naganna et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.1594.pdf