SlidesGen-Bench: Evaluating Slides Generation via Computational and Quantitative Metrics

Yunqiao Yang, Wenbo Li, Houxing Ren, Zimu Lu, Ke Wang, Zhiyuan Huang, Zhuofan Zong, Mingjie Zhan, Hongsheng Li


Abstract
The rapid evolution of Large Language Models (LLMs) has fostered diverse paradigms for automated slide generation, ranging from code-driven layouts to image-centric synthesis. However, evaluating these heterogeneous systems remains challenging, as existing protocols often struggle to provide comparable scores across architectures or rely on uncalibrated judgments. In this paper, we introduce SlidesGen-Bench, a benchmark designed to evaluate slide generation through a lens of three core principles: universality, quantification, and reliability. First, to establish a consistent evaluation framework, we ground our primary analysis in the visual domain, treating terminal outputs as visual renderings for consistent comparison, while acknowledging format-conditional ceilings in structural editability. Second, we propose a structured computational approach that quantitatively assesses slides across three distinct dimensions—Content, Aesthetics, and Editability. Finally, we ensure high correlation with human preference for the highly subjective aesthetic dimensions by constructing the Slides-Align1.5k dataset. Our experiments demonstrate that SlidesGen-Bench achieves a significantly higher degree of alignment with human judgment than existing evaluation pipelines. Our code and data are released to support further research.
Anthology ID:
2026.emnlp-main.1482
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
33865–33907
Language:
URL:
https://aclanthology.org/2026.emnlp-main.1482/
DOI:
Bibkey:
Cite (ACL):
Yunqiao Yang, Wenbo Li, Houxing Ren, Zimu Lu, Ke Wang, Zhiyuan Huang, Zhuofan Zong, Mingjie Zhan, and Hongsheng Li. 2026. SlidesGen-Bench: Evaluating Slides Generation via Computational and Quantitative Metrics. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 33865–33907, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
SlidesGen-Bench: Evaluating Slides Generation via Computational and Quantitative Metrics (Yang et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.1482.pdf