FigmaBench: Evaluating Design-to-Code Generation in Real-World Handoff Scenarios

Ziyang Wang, Ziyang Liu, Xin Yin, Chao Zhang, Zhe Cui, Yue Lu


Abstract
Automating design-to-code translation remains a longstanding goal in software engineering. While Multimodal Large Language Models (MLLMs) have shown promise in design-to-code tasks, existing benchmarks rely solely on screenshots, discarding the structured metadata indispensable in real-world design handoff workflows. Furthermore, current evaluation paradigms are deficient, as code-level metrics fail to account for implementation variability and visual metrics overlook fine-grained defects, while standardized assessments for responsive behaviors remain absent. To address these limitations, we introduce FigmaBench, an industrial-grade benchmark for multimodal design-to-code generation. We collect raw design files from the Figma Community and apply a multi-stage pipeline to curate 1,234 high-quality samples, each comprising high-resolution screenshots and complete JSON metadata. We further propose a comprehensive evaluation framework with four complementary metrics: visual consistency (VCS), structural layout alignment (SLA), textual and stylistic fidelity (TSF), and responsive quality score (RQS). Through extensive evaluation of state-of-the-art MLLMs, we uncover a critical fidelity-responsiveness paradox: models achieving high visual fidelity tend to generate rigid, non-responsive code. We trace this phenomenon to a metadata trap, where models shortcut layout reasoning by directly transcribing absolute coordinates rather than generating fluid structures. Our data and code are available at https://anonymous.4open.science/r/FigmaBench-6C84/.
Anthology ID:
2026.findings-emnlp.2342
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
50344–50363
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.2342/
DOI:
Bibkey:
Cite (ACL):
Ziyang Wang, Ziyang Liu, Xin Yin, Chao Zhang, Zhe Cui, and Yue Lu. 2026. FigmaBench: Evaluating Design-to-Code Generation in Real-World Handoff Scenarios. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 50344–50363, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
FigmaBench: Evaluating Design-to-Code Generation in Real-World Handoff Scenarios (Wang et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.2342.pdf