Yang Xiang
Author directoryOther people with similar names: Yang Xiang, Yang Xiang, Yang Xiang
Unverified author pages with similar names: Yang Xiang
2026
Less Uniform Discrete Diffusion is More Powerful and Scalable
Kaibo Wang | Ding Ding | Fangyu Ding | Zijin Feng | Han Shi | Haoli Bai | Jiacheng Sun | Yang Xiang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Kaibo Wang | Ding Ding | Fangyu Ding | Zijin Feng | Han Shi | Haoli Bai | Jiacheng Sun | Yang Xiang
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Although uniform diffusion language models (UDLMs) represent a promising diffusion paradigm, scaling them remains challenging. We identify the core obstacle as an over-uniform training objective and condition-target confusion during sampling. To address these, we propose Less Uniform Diffusion (LUDI), a novel UDLM framework. Specifically, we (i) introduce a less uniform loss that directs each reverse transition toward the clean token, and (ii) equip the model with per-token time embeddings that supply token-level corruption hints, enabling confidence-based few-step sampling. Experiments across scales show that LUDI yields cleaner supervision and improves few-step generation. We further continue-train a 7B autoregressive model into LUDI-7B, resulting in a UDLM capable of complex reasoning. It achieves 3 token-per-step speedup over AR decoding and a competitive performance compared with masked diffusion baselines, revealing that the full potential of UDLMs for complex generation remains to be unlocked.