Jan Kautz
Author directory2026
Nemotron-Labs-Diffusion: A Tri-Mode Language Model Unifying Autoregressive, Diffusion, and Self-Speculation Decoding
Yonggan Fu | Lexington Whalen | Abhinav Garg | Chengyue Wu | Maksim Khadkevich | Nicolai Oswald | Enze Xie | Daniel Egert | Sharath Turuvekere Sreenivas | Shizhe Diao | Chenhan D. Yu | Ye Yu | Weijia Chen | Sajad Norouzi | Jingyu Liu | Shiyi Lan | Ligeng Zhu | Jin Wang | Jindong Jiang | Morteza Mardani | Mehran Maghoumi | Song Han | Ante Jukić | Nima Tajbakhsh | Jan Kautz | Pavlo Molchanov
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Yonggan Fu | Lexington Whalen | Abhinav Garg | Chengyue Wu | Maksim Khadkevich | Nicolai Oswald | Enze Xie | Daniel Egert | Sharath Turuvekere Sreenivas | Shizhe Diao | Chenhan D. Yu | Ye Yu | Weijia Chen | Sajad Norouzi | Jingyu Liu | Shiyi Lan | Ligeng Zhu | Jin Wang | Jindong Jiang | Morteza Mardani | Mehran Maghoumi | Song Han | Ante Jukić | Nima Tajbakhsh | Jan Kautz | Pavlo Molchanov
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Diffusion language models (LMs) enable parallel decoding, but still lag behind autoregressive (AR) LMs in accuracy, and behind multi-token prediction (MTP) methods in efficiency. This raises three questions: should diffusion LMs compete with AR LMs or be harmonized with them; can diffusion provide a stronger acceleration mechanism than MTP; and does diffusion decoding have sufficient long-term potential to justify further exploration? We study these questions through Nemotron-Labs-Diffusion, a tri-mode LM that unifies three decoding modes—AR, diffusion, and self-speculation (diffusion drafts, AR verifies)—within a single model to sustain high throughput across all concurrency levels. Our study shows that (1) AR and diffusion objectives are mutually beneficial rather than competing, (2) diffusion-based self-speculation achieves higher acceptance lengths and better system vs. per-user throughput trade-offs than MTP baselines, and (3) diffusion decoding shows strong potential for parallel decoding under an optimal sampler in a speed-of-light analysis. Based on these insights, we develop the Nemotron-Labs-Diffusion family at 3B, 8B, and 14B scales. Our models outperform state-of-the-art open-source AR and diffusion LMs in both accuracy and speed, e.g., achieving 6x tokens per forward over Qwen3-8B with comparable benchmark accuracy, translating to 4x throughput on SPEED-Bench measured with SGLang on an NVIDIA GB200 GPU.
2020
Learning to Generate Multiple Style Transfer Outputs for an Input Sentence
Kevin Lin | Ming-Yu Liu | Ming-Ting Sun | Jan Kautz
Proceedings of the Fourth Workshop on Neural Generation and Translation
Kevin Lin | Ming-Yu Liu | Ming-Ting Sun | Jan Kautz
Proceedings of the Fourth Workshop on Neural Generation and Translation
Text style transfer refers to the task of rephrasing a given text in a different style. While various methods have been proposed to advance the state of the art, they often assume the transfer output follows a delta distribution, and thus their models cannot generate different style transfer results for a given input text. To address the limitation, we propose a one-to-many text style transfer framework. In contrast to prior works that learn a one-to-one mapping that converts an input sentence to one output sentence, our approach learns a one-to-many mapping that can convert an input sentence to multiple different output sentences, while preserving the input content. This is achieved by applying adversarial training with a latent decomposition scheme. Specifically, we decompose the latent representation of the input sentence to a style code that captures the language style variation and a content code that encodes the language style-independent content. We then combine the content code with the style code for generating a style transfer output. By combining the same content code with a different style code, we generate a different style transfer output. Extensive experimental results with comparisons to several text style transfer approaches on multiple public datasets using a diverse set of performance metrics validate effectiveness of the proposed approach.
Search
Fix author
Co-authors
- Weijia Chen 1
- Shizhe Diao 1
- Daniel Egert 1
- Yonggan Fu 1
- Abhinav Garg 1
- Song Han 1
- Jindong Jiang 1
- Ante Jukić 1
- Maksim Khadkevich 1
- Shiyi Lan 1
- Kevin Lin 1
- Jingyu Liu 1
- Ming-Yu Liu 1
- Mehran Maghoumi 1
- Morteza Mardani 1
- Pavlo Molchanov 1
- Sajad Norouzi 1
- Nicolai Oswald 1
- Ming-Ting Sun 1
- Nima Tajbakhsh 1
- Sharath Turuvekere Sreenivas 1
- Jin Wang 1
- Lexington Whalen 1
- Chengyue Wu 1
- Enze Xie 1
- Chenhan D. Yu 1
- Ye Yu 1
- Ligeng Zhu 1