Inference-Time Scaling in Diffusion Models: A Beam Search Approach to Visual Sequences Generation

Guilherme Fernandes, Vasco Ramos, Regev Cohen, Idan Szpektor, Joao Magalhaes


Abstract
While diffusion models produce high-quality images, they often lack consistency in sequences, especially for non-linear visual sequences. To solve this, we introduce an inference-time scaling beam search strategy for latent space exploration, enabling the conditional generation of coherent image sequences through beam search diffusion. In contrast to earlier methods that rely on fixed latent priors, our method dynamically samples past latents to search for an optimal sequence of latent representations, ensuring coherent visual transitions. As the latent denoising space is explored, the beam search graph is pruned with a cross-attention mechanism that efficiently scores search paths, prioritizing alignment with both textual prompts and visual context. Human and automatic evaluations confirm that BeamDiffusion outperforms other baseline methods, producing full sequences with superior coherence, visual continuity, and textual alignment.
Anthology ID:
2026.findings-emnlp.2107
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
44886–44909
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.2107/
DOI:
Bibkey:
Cite (ACL):
Guilherme Fernandes, Vasco Ramos, Regev Cohen, Idan Szpektor, and Joao Magalhaes. 2026. Inference-Time Scaling in Diffusion Models: A Beam Search Approach to Visual Sequences Generation. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 44886–44909, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Inference-Time Scaling in Diffusion Models: A Beam Search Approach to Visual Sequences Generation (Fernandes et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.2107.pdf