Compositional SVG Generation via VLM-Driven Hierarchical Semantic Parsing

Sehwan Park, Taehoon Kim, Geonhee Han, Dohyun Kim, Seung Wook Kim, Paul Hongsuck Seo


Abstract
While Vision-Language Models (VLMs) excel at visual reasoning, generating structured, editable Scalable Vector Graphics (SVG) remains a fundamental challenge. Existing pipelines predominantly yield flat, semantically agnostic collections of paths, where editing a single object requires manually identifying its constituent paths. To address this, we propose a VLM-driven agentic framework for semantic compositional SVG generation. Our pipeline recursively parses visual scenes into semantic and geometric hierarchies via top- down decomposition, visual grounding, and prompt-driven amodal occlusion recovery, ensuring each component is geometrically complete. Furthermore, we introduce the Semantic SVG Benchmark with human-annotated semantic groups and novel sub-component metrics (Semantic Recall/Precision, PERE) to explicitly evaluate structural compositionality and functional editability. Experiments show that our natively predicted structures surpass the upper bounds of existing flat-generation methods in both grouping quality and editability, while maintaining state-of-the-art visual fidelity.
Anthology ID:
2026.emnlp-main.2375
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
53942–53967
Language:
URL:
https://aclanthology.org/2026.emnlp-main.2375/
DOI:
Bibkey:
Cite (ACL):
Sehwan Park, Taehoon Kim, Geonhee Han, Dohyun Kim, Seung Wook Kim, and Paul Hongsuck Seo. 2026. Compositional SVG Generation via VLM-Driven Hierarchical Semantic Parsing. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 53942–53967, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Compositional SVG Generation via VLM-Driven Hierarchical Semantic Parsing (Park et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.2375.pdf