Tell2Design: A Dataset for Language-Guided Floor Plan Generation

Sicong Leng, Yang Zhou, Mohammed Haroon Dupty, Wee Sun Lee, Sam Joyce, Wei Lu


Abstract
We consider the task of generating designs directly from natural language descriptions, and consider floor plan generation as the initial research area. Language conditional generative models have recently been very successful in generating high-quality artistic images. However, designs must satisfy different constraints that are not present in generating artistic images, particularly spatial and relational constraints. We make multiple contributions to initiate research on this task. First, we introduce a novel dataset, Tell2Design (T2D), which contains more than 80k floor plan designs associated with natural language instructions. Second, we propose a Sequence-to-Sequence model that can serve as a strong baseline for future research. Third, we benchmark this task with several text-conditional image generation models. We conclude by conducting human evaluations on the generated samples and providing an analysis of human performance. We hope our contributions will propel the research on language-guided design generation forward.
Anthology ID:
2023.acl-long.820
Volume:
Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Anna Rogers, Jordan Boyd-Graber, Naoaki Okazaki
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
14680–14697
Language:
URL:
https://aclanthology.org/2023.acl-long.820
DOI:
10.18653/v1/2023.acl-long.820
Bibkey:
Cite (ACL):
Sicong Leng, Yang Zhou, Mohammed Haroon Dupty, Wee Sun Lee, Sam Joyce, and Wei Lu. 2023. Tell2Design: A Dataset for Language-Guided Floor Plan Generation. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 14680–14697, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
Tell2Design: A Dataset for Language-Guided Floor Plan Generation (Leng et al., ACL 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.acl-long.820.pdf
Video:
 https://aclanthology.org/2023.acl-long.820.mp4