When to Change the Canvas? Safe Adaptive Variable-Length Decoding for Diffusion Language Models

Junzhuo Li, Tianhao Li, Hao-Ran Wei, Xiang Li, Baosong Yang, Xuming Hu


Abstract
Diffusion language models generate text by denoising a masked canvas, but usually require the canvas length to be fixed before decoding. This leads to an allocation dilemma: short canvases may truncate outputs, while overlong canvases waste computation and introduce noisy continuations. Existing variable-length methods adapt the canvas through expansion or length search, but largely ignore whether such intervention is safe. We argue that canvas editing can perturb partially stabilized denoising trajectories, and propose Safe Adaptive Canvas Decoding (SACD), a training-free framework for conservative canvas control. SACD diagnoses allocation, estimates intervention risk, and chooses among expand, shrink, and keep. Experiments across reasoning, code generation, and infilling tasks show that SACD improves accuracy, latency, and token utilization across multiple DLM backbones, highlighting safe sparse intervention as a key principle for variable-length diffusion decoding.
Anthology ID:
2026.findings-emnlp.2224
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
47641–47654
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.2224/
DOI:
Bibkey:
Cite (ACL):
Junzhuo Li, Tianhao Li, Hao-Ran Wei, Xiang Li, Baosong Yang, and Xuming Hu. 2026. When to Change the Canvas? Safe Adaptive Variable-Length Decoding for Diffusion Language Models. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 47641–47654, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
When to Change the Canvas? Safe Adaptive Variable-Length Decoding for Diffusion Language Models (Li et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.2224.pdf