Shihai Chen
2025
UIOrchestra: Generating High-Fidelity Code from UI Designs with a Multi-agent System
Chuhuai Yue
|
Jiajun Chai
|
Yufei Zhang
|
Zixiang Ding
|
Xihao Liang
|
Peixin Wang
|
Shihai Chen
|
Wang Yixuan
|
Wangyanping
|
Guojun Yin
|
Wei Lin
Findings of the Association for Computational Linguistics: EMNLP 2025
Recent advances in large language models (LLMs) have significantly improved automated code generation, enabling tools such as GitHub Copilot and CodeWhisperer to assist developers in a wide range of programming tasks. However, the translation of complex mobile UI designs into high-fidelity front-end code remains a challenging and underexplored area, especially as modern app interfaces become increasingly intricate. In this work, we propose UIOrchestra, a collaborative multi-agent system designed for the AppUI2Code task, which aims to reconstruct static single-page applications from design mockups. UIOrchestra integrates three specialized agents, layout description, code generation, and difference analysis agent that work collaboratively to address the limitations of single-model approaches. To facilitate robust evaluation, we introduce APPUI, the first benchmark dataset for AppUI2Code, constructed through a human-in-the-loop process to ensure data quality and coverage. Experimental results demonstrate that UIOrchestra outperforms existing methods in reconstructing complex app pages and highlight the necessity of multi-agent collaboration for this task. We hope our work will inspire further research on leveraging LLMs for front-end automation. The code and data will be released upon paper acceptance.
Search
Fix author
Co-authors
- Jiajun Chai 1
- Zixiang Ding 1
- Xihao Liang 1
- Wei Lin 1
- Peixin Wang 1
- show all...