AutoTemplate: A Simple Recipe for Lexically Constrained Text Generation

Hayate Iso


Abstract
Lexically constrained text generation is one of the constrained text generation tasks, which aims to generate text that covers all the given constraint lexicons. While the existing approaches tackle this problem using a lexically constrained beam search algorithm or dedicated model using non-autoregressive decoding, there is a trade-off between the generated text quality and the hard constraint satisfaction. We introduce AutoTemplate, a simple yet effective lexically constrained text generation framework divided into template generation and lexicalization tasks. The template generation is to generate the text with the placeholders, and lexicalization replaces them into the constraint lexicons to perform lexically constrained text generation. We conducted the experiments on two tasks: keywords-to-sentence generations and entity-guided summarization. Experimental results show that the AutoTemplate outperforms the competitive baselines on both tasks while satisfying the hard lexical constraints. The code is available at https://github.com/megagonlabs/autotemplate
Anthology ID:
2024.inlg-main.1
Volume:
Proceedings of the 17th International Natural Language Generation Conference
Month:
September
Year:
2024
Address:
Tokyo, Japan
Editors:
Saad Mahamood, Nguyen Le Minh, Daphne Ippolito
Venue:
INLG
SIG:
SIGGEN
Publisher:
Association for Computational Linguistics
Note:
Pages:
1–12
Language:
URL:
https://aclanthology.org/2024.inlg-main.1
DOI:
Bibkey:
Cite (ACL):
Hayate Iso. 2024. AutoTemplate: A Simple Recipe for Lexically Constrained Text Generation. In Proceedings of the 17th International Natural Language Generation Conference, pages 1–12, Tokyo, Japan. Association for Computational Linguistics.
Cite (Informal):
AutoTemplate: A Simple Recipe for Lexically Constrained Text Generation (Iso, INLG 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.inlg-main.1.pdf
Supplementary attachment:
 2024.inlg-main.1.Supplementary_Attachment.pdf