WordArt Designer: User-Driven Artistic Typography Synthesis using Large Language Models

Jun-Yan He, Zhi-Qi Cheng, Chenyang Li, Jingdong Sun, Wangmeng Xiang, Xianhui Lin, Xiaoyang Kang, Zengke Jin, Yusen Hu, Bin Luo, Yifeng Geng, Xuansong Xie


Abstract
This paper introduces WordArt Designer, a user-driven framework for artistic typography synthesis, relying on the Large Language Model (LLM). The system incorporates four key modules: the LLM Engine, SemTypo, StyTypo, and TexTypo modules. 1) The LLM Engine, empowered by the LLM (e.g. GPT-3.5), interprets user inputs and generates actionable prompts for the other modules, thereby transforming abstract concepts into tangible designs. 2) The SemTypo module optimizes font designs using semantic concepts, striking a balance between artistic transformation and readability. 3) Building on the semantic layout provided by the SemTypo module, the StyTypo module creates smooth, refined images. 4) The TexTypo module further enhances the design’s aesthetics through texture rendering, enabling the generation of inventive textured fonts. Notably, WordArt Designer highlights the fusion of generative AI with artistic typography. Experience its capabilities on ModelScope: https://www.modelscope.cn/studios/WordArt/WordArt.
Anthology ID:
2023.emnlp-industry.23
Volume:
Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing: Industry Track
Month:
December
Year:
2023
Address:
Singapore
Editors:
Mingxuan Wang, Imed Zitouni
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
223–232
Language:
URL:
https://aclanthology.org/2023.emnlp-industry.23
DOI:
10.18653/v1/2023.emnlp-industry.23
Bibkey:
Cite (ACL):
Jun-Yan He, Zhi-Qi Cheng, Chenyang Li, Jingdong Sun, Wangmeng Xiang, Xianhui Lin, Xiaoyang Kang, Zengke Jin, Yusen Hu, Bin Luo, Yifeng Geng, and Xuansong Xie. 2023. WordArt Designer: User-Driven Artistic Typography Synthesis using Large Language Models. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing: Industry Track, pages 223–232, Singapore. Association for Computational Linguistics.
Cite (Informal):
WordArt Designer: User-Driven Artistic Typography Synthesis using Large Language Models (He et al., EMNLP 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.emnlp-industry.23.pdf
Video:
 https://aclanthology.org/2023.emnlp-industry.23.mp4