Rohan Kapoor
Author directory2026
Consistency Training Along the Transformer Stack
Sukrati Gautam | Neil Shah | Arav Dhoot | Bryan Maruyama | Caroline Wei | Rohan Kapoor | Robert Sidey | Prakhar Gupta | Zi Cheng Huang | David Demitri Africa
Findings of the Association for Computational Linguistics: EMNLP 2026
Sukrati Gautam | Neil Shah | Arav Dhoot | Bryan Maruyama | Caroline Wei | Rohan Kapoor | Robert Sidey | Prakhar Gupta | Zi Cheng Huang | David Demitri Africa
Findings of the Association for Computational Linguistics: EMNLP 2026
Consistency training encourages models to behave similarly across different contexts, and has shown promise for reducing misalignment. We broaden the scope of consistency training in two ways. First, we introduce two new internal consistency targets: MLP Consistency Training (MLPCT), which matches post-activation MLP states, and Attention Consistency Training (AttCT), which matches per-head attention distributions. Second, we apply consistency training to four additional safety threats: persona in-context learning attacks, adversarial frustration, prefill attacks, and conditional misalignment. Across several models and threat settings, we find that consistency training reduces misalignment well beyond the sycophancy and jailbreak settings studied in prior work. The effective consistency target depends on the structure of the threat: representation-level targets suit wrapper-style failures, while output-level BCT is the reliable choice for trajectory-level failures such as prefill, frustration, and conditional misalignment. We also find cases of cross-threat generalization, where training against one failure mode improves robustness to another, and identify a shared residual-stream mechanism underlying ACT, MLPCT, and AttCT, while distinguishing BCT as mechanistically distinct. Our results suggest that consistency training is a flexible and extensible framework for alignment, capable of unifying defenses against a broader class of model pathologies.