FLUID-V: Elastic-Horizon Diffusion Decoding for Vision-Language Models

Xiangyu Ma, Teng Xiao, Zuchao Li, Ping Wang, Hai Zhao


Abstract
Autoregressive vision-language models achieve strong multimodal understanding, but their sequential decoding becomes increasingly inefficient as multimodal responses grow longer. Adapting AR-VLMs to diffusion-style block decoding is promising, yet fixed refinement blocks struggle with sharply varying multimodal uncertainty in OCR, chart, document, and reasoning-heavy outputs. Binary mask-or-token states further limit local refinement, as masking discards partial evidence while premature commitment can corrupt the causal prefix. We present FLUID-V, a lightweight AR-to-diffusion adaptation framework for reliable local multimodal refinement. FLUID-V selects refinement spans with elastic horizons and represents unresolved positions as evolving soft semantic mixtures in embedding space. Only confident predictions are committed to the persistent KV cache, preserving causal multimodal conditioning and autoregressive compatibility. Experiments with OpenPangu-VL-7B and 100K self-distilled samples show competitive performance across diverse multimodal benchmarks, with ablations confirming the importance of adaptive horizons and stateful intermediate representations. Our code is available at https://github.com/Oli-lab-nun/FLUID-V.
Anthology ID:
2026.emnlp-main.347
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
7990–8003
Language:
URL:
https://aclanthology.org/2026.emnlp-main.347/
DOI:
Bibkey:
Cite (ACL):
Xiangyu Ma, Teng Xiao, Zuchao Li, Ping Wang, and Hai Zhao. 2026. FLUID-V: Elastic-Horizon Diffusion Decoding for Vision-Language Models. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 7990–8003, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
FLUID-V: Elastic-Horizon Diffusion Decoding for Vision-Language Models (Ma et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.347.pdf