Predicting Steering Vectors and Adapter Weights for Few-Shot Author-Style Transfer

Leonard Popp, Danni Liu, Supriti Sinhamahapatra, Jan Niehues


Abstract
Adapting large language models to an individual author’s style from a few examples is challenging, and scientific writing sharpens the difficulty: formal conventions leave little surface variation, and authors write about their own topics, so extracted “style” easily entangles with content. We study style-conditioned abstract generation from a few example abstracts per author and propose three methods: (1) contrastive activation steering, (2) a network that predicts steering vectors, and (3) a hypernetwork that predicts LoRA adapters. We find a consistent trade-off between style imitation and output quality: fine-tuning buys most of the available style signal but forfeits fluency, while the hypernetwork achieves the best trade-off on both seen and unseen authors. Our steering operates at author level, contrasting an author’s abstracts against style-neutral generations for the same content. This holds topic fixed, removes the need for a predefined style inventory, and outperforms inventory-based steering. Moreover, our analyses demonstrate that manually extracted and predicted steering vectors are near-orthogonal yet score comparably, indicating that style conditioning here can admit at least two unrelated directions rather than requiring one particular axis.
Anthology ID:
2026.wnut-1.17
Volume:
Proceedings of the 11th Workshop on Natural User-generated Text
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
JinYeong Bak, Rob van der Goot, Hyeju Jang, Weerayut Buaphet, Alan Ramponi, Wei Xu, Alan Ritter
Venues:
WNUT | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
227–243
Language:
URL:
https://aclanthology.org/2026.wnut-1.17/
DOI:
Bibkey:
Cite (ACL):
Leonard Popp, Danni Liu, Supriti Sinhamahapatra, and Jan Niehues. 2026. Predicting Steering Vectors and Adapter Weights for Few-Shot Author-Style Transfer. In Proceedings of the 11th Workshop on Natural User-generated Text, pages 227–243, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Predicting Steering Vectors and Adapter Weights for Few-Shot Author-Style Transfer (Popp et al., WNUT 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.wnut-1.17.pdf