A Benchmark for the Generation and Evaluation of Scientific Architecture Diagrams in HTML/SVG

Kyeongman Park, Kang-il Lee, Janghoon Han, Yerin Hwang, Taegwan Kang, Minwoo Lee, Changho Lee, Kyomin Jung


Abstract
While Large Language Models (LLMs) can now automate many parts of scientific writing, architectural figure generation faces a critical modality bottleneck because image outputs are inherently difficult to edit, verify, and integrate into text-native LLM workflows. To enable fully text-driven synthesis, we propose a new task: generating architectural figures as pure HTML/SVG source code. Furthermore, we introduce FigureCode, a novel benchmark that evaluates structural fidelity and visual properties through code-based evaluation. Our benchmark improves agreement with human judgments by 0.35 Kendall’s τ over prior VLM-based methods. Moreover, the figure-as-code paradigm improves edit-instruction success rate by 30% and retrieval F1 score by 25.3% over baselines, while achieving 66.1% WCAG/ARIA accessibility coverage.
Anthology ID:
2026.findings-emnlp.2060
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
43868–43887
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.2060/
DOI:
Bibkey:
Cite (ACL):
Kyeongman Park, Kang-il Lee, Janghoon Han, Yerin Hwang, Taegwan Kang, Minwoo Lee, Changho Lee, and Kyomin Jung. 2026. A Benchmark for the Generation and Evaluation of Scientific Architecture Diagrams in HTML/SVG. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 43868–43887, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
A Benchmark for the Generation and Evaluation of Scientific Architecture Diagrams in HTML/SVG (Park et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.2060.pdf