Striking Gold in Advertising: Standardization and Exploration of Ad Text Generation

Masato Mita, Soichiro Murakami, Akihiko Kato, Peinan Zhang


Abstract
In response to the limitations of manual ad creation, significant research has been conducted in the field of automatic ad text generation (ATG). However, the lack of comprehensive benchmarks and well-defined problem sets has made comparing different methods challenging. To tackle these challenges, we standardize the task of ATG and propose a first benchmark dataset, CAMERA, carefully designed and enabling the utilization of multi-modal information and facilitating industry-wise evaluations. Our extensive experiments with a variety of nine baselines, from classical methods to state-of-the-art models including large language models (LLMs), show the current state and the remaining challenges. We also explore how existing metrics in ATG and an LLM-based evaluator align with human evaluations.
Anthology ID:
2024.acl-long.54
Volume:
Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
August
Year:
2024
Address:
Bangkok, Thailand
Editors:
Lun-Wei Ku, Andre Martins, Vivek Srikumar
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
955–972
Language:
URL:
https://aclanthology.org/2024.acl-long.54
DOI:
10.18653/v1/2024.acl-long.54
Bibkey:
Cite (ACL):
Masato Mita, Soichiro Murakami, Akihiko Kato, and Peinan Zhang. 2024. Striking Gold in Advertising: Standardization and Exploration of Ad Text Generation. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 955–972, Bangkok, Thailand. Association for Computational Linguistics.
Cite (Informal):
Striking Gold in Advertising: Standardization and Exploration of Ad Text Generation (Mita et al., ACL 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.acl-long.54.pdf