Reproducing and Evaluating the Generalizability of Subliminal Learning in Open-Weight Models

Daan van der Weijden, Nathan Brack, Selene Baez Santamaria


Abstract
In this reproduction paper we investigate subliminal learning, a consequence of distillation where teacher models transmit behavioral preference traits through semantically unrelated data. The original paper explores two types of traits (animal preferences and misalignment), three data modalities (number sequences, code, and chain of thought), and several model families. We reproduce their experiments and extend the setup along three axes: new preference categories (actors and politicians), a new task (chess move generation), and an additional open-weight model (Ministral8B). We also run a controlled ablation on the numbers task’s answer-space size (1-, 2-, and 3-digit sequences). We focus on open-weight models with accessible checkpoints on HuggingFace, since the original paper’s GPT-4.x fine-tuning is no longer available. Our reproduction supports the original paper’s claims, but our extensions show they are not universal as transmission strength varies across traits and tasks, and one model shows almost no effect at all.
Anthology ID:
2026.blackboxnlp-1.62
Volume:
Proceedings of the 9th BlackboxNLP Workshop: Analyzing and Interpreting Neural Networks for NLP
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Dana Arad, Yonatan Belinkov, Hanjie Chen, Nils Feldhus, Aaron Mueller, Hosein Mohebbi, Gabriele Sarti, Martin Tutek
Venues:
BlackboxNLP | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1113–1120
Language:
URL:
https://aclanthology.org/2026.blackboxnlp-1.62/
DOI:
Bibkey:
Cite (ACL):
Daan van der Weijden, Nathan Brack, and Selene Baez Santamaria. 2026. Reproducing and Evaluating the Generalizability of Subliminal Learning in Open-Weight Models. In Proceedings of the 9th BlackboxNLP Workshop: Analyzing and Interpreting Neural Networks for NLP, pages 1113–1120, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Reproducing and Evaluating the Generalizability of Subliminal Learning in Open-Weight Models (van der Weijden et al., BlackboxNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.blackboxnlp-1.62.pdf