Dongmin Kim
Author directoryOther people with similar names: Dongmin Kim
2026
LEVEE: Layer-wise Evaluation of Vector Encoding Effects: Bias Localization and Functional Separation across 11 LLMs
Dongmin Kim | Youhyun Shin
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Dongmin Kim | Youhyun Shin
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Large language models encode social biases that instruction fine-tuning aims to suppress. Instruction fine-tuning applies its weight changes through the alignment task vector ΔW, yet prior work treats it as a monolithic object, leaving its internal layer structure opaque: which layers carry bias suppression, which carry general capability, and whether these are separable, remains unknown. We map this structure by injecting each layer’s ΔWᵢ independently into the base model across 11 LLMs from Qwen2.5, Gemma-2/3, and Llama-3 families (0.5B–14B). Testing via per-layer sufficiency sweeps, block removal, and a BBQ–MMLU dissociation, we find three results. First, BBQ-measured bias suppression localizes to the mid-third of transformer layers in 9 of 11 models, with mid-third removal raising bias across all 11 while first- and last-third removals produce smaller L-BBQ increases in all nine structured-signal models. Second, mid- and first-third removals dissociate BBQ and MMLU: mid-third removal is BBQ-critical across all tested models while first-third removal can sharply reduce MMLU in Gemma architectures, supporting functional separation of bias suppression and capability in weight space. Third, mid-third removal raises bias above the unaligned base in 3 of 11 cases: partial ΔW transfer without the mid-third can make a model more biased than the unaligned base model. These findings provide an empirical roadmap for targeted debiasing and safe task vector composition.