Sunwoo Hong
Author directory2026
Pivot-SD: Efficient Self-Distillation for Masked Diffusion Language Models
Seo Hyun Kim | Sunwoo Hong | Younwoo Choi | Chen-Hao Chao | Se-Young Yun | Rahul G Krishnan
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Seo Hyun Kim | Sunwoo Hong | Younwoo Choi | Chen-Hao Chao | Se-Young Yun | Rahul G Krishnan
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Masked diffusion language models (dLMs) offer a promising parallel alternative to autoregressive models for complex reasoning. However, they face a unique credit-assignment challenge: reasoning failures typically stem from a few critical, early commitments that cascade downstream. Existing post-training overlooks this dynamic: supervised fine-tuning (SFT) weights all tokens uniformly, while online reinforcement learning (RL) attributes a single trajectory-level reward to every position. We introduce Pivot-SD, an efficient offline framework supervising only these high-impact bottlenecks (pivots). Pivot-SD isolates pivots using an information-gain metric measuring uncertainty reduction over the remaining masked block. It applies bidirectional supervision: successful pivots are reinforced with cross-entropy, while critical errors in failed trajectories are suppressed via targeted unlikelihood, preserving valid surrounding sub-steps. Using only 200 questions and four rollouts each, Pivot-SD improves LLaDA-8B-Instruct over full-sequence SFT and budget-matched diffusion RL baselines across math and code benchmarks.