Weitao Huang
Author directoryOther people with similar names: Weitao Huang
2026
Efficient Diffusion Language Models: A Comprehensive Survey
Haokun Lin | Xinle Jia | Shaozhen Liu | Shujun Xia | Weitao Huang | Haobo Xu | Junyang LI | Yicheng Xiao | Xingrun Xing | Ziyu Guo | Renrui Zhang | Qi Li | Yichen Wu | Renzhen Wang | Xiaojuan Qi | Deyu Meng | Caifeng Shan | Hongsheng Li | Zhenan Sun
Findings of the Association for Computational Linguistics: EMNLP 2026
Haokun Lin | Xinle Jia | Shaozhen Liu | Shujun Xia | Weitao Huang | Haobo Xu | Junyang LI | Yicheng Xiao | Xingrun Xing | Ziyu Guo | Renrui Zhang | Qi Li | Yichen Wu | Renzhen Wang | Xiaojuan Qi | Deyu Meng | Caifeng Shan | Hongsheng Li | Zhenan Sun
Findings of the Association for Computational Linguistics: EMNLP 2026
Diffusion language models (dLLMs) have recently emerged as a promising alternative to autoregressive (AR) language models, offering competitive performance with a fundamentally different generation paradigm. Instead of producing tokens strictly left-to-right, dLLMs iteratively refine partially masked sequences, enabling bidirectional context modeling and supporting parallel token updates. This design creates new opportunities for accelerating generation and improving controllability. However, practical deployment of dLLMs remains challenging due to the high cost of training at scale and the lack of mature inference optimizations such as cache-friendly decoding and robust parallel sampling. In this work, we provide a comprehensive overview of recent progress on efficient dLLMs. To reflect how efficiency bottlenecks arise across the full lifecycle of dLLMs, spanning training, decoding, and deployment, we organize existing approaches into five categories: Training, Inference, Context, Framework, and Multimodality. For each category, we summarize representative methods and highlight their motivations, key techniques, and empirical trade-offs. Finally, we discuss open challenges and outline promising directions for future research toward high-throughput, robust, and practically deployable diffusion language models.