Yikai Zhao
Author directory2026
Context-Aware Cluster Decoding: Semantic Anchor-Driven Coherence in dMLLMs
Yikai Zhao | Qiyan Zhao | Jiaquan Zhang | Xiaofeng Zhang | Xiaosong Yuan | Pengzhou Cheng
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Yikai Zhao | Qiyan Zhao | Jiaquan Zhang | Xiaofeng Zhang | Xiaosong Yuan | Pengzhou Cheng
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Diffusion multimodal large language models (dMLLMs) frequently produce long-form outputs marred by semantic drift and repetition, with quality generally degrading as output length increases. We identify two structural deficiencies in existing decoding methods as primary drivers of these failures: confidence-based scoring ignores decoded-neighbor support, and block partitioning prevents access to high-readiness semantic anchors. Together, these deficiencies cause tokens to be committed before their local context is sufficiently established. We propose CACD (Context-Aware Cluster Decoding), a training-free decoding method that scores each masked position using a multiplicative combination of softmax confidence and neighbor proximity. This approach prioritizes contextually ready tokens over isolated candidates while suppressing low-confidence positional noise. CACD operates without block partitioning, keeping high-readiness anchors globally accessible. It further applies architecture-aware calibration to handle confidence heterogeneity induced by diverse visual integration strategies. Experiments on three dMLLMs across four benchmarks demonstrate consistent quality gains and hallucination reduction over the original decoding methods, with larger gains in several longer-generation settings. These results highlight the importance of neighbor support and visual integration strategies for the future design of dMLLM decoding methods. Our code is openly available at https://github.com/zhaoyk-sysu/CACD-dMLLM.