Composing Ci with Reinforced Non-autoregressive Text Generation

Yan Song


Abstract
Composing Ci (also widely known as Song Ci), a special type of classical Chinese poetry, requires to follow particular format once their tune patterns are given. To automatically generate a well-formed Ci, text generation systems should strictly take into account pre-defined rigid formats (e.g., length and rhyme). Yet, most existing approaches regard Ci generation as a conventional sequence-to-sequence task and use autoregressive models, while it is challenging for such models to properly handle the constraints (according to tune patterns) of Ci during the generation process. Moreover, consider that with the format prepared, Ci generation can be operated by an efficient synchronous process, where autoregressive models are limited in doing so since they follow the character-by-character generation protocol. Therefore, in this paper, we propose to compose Ci through a non-autoregressive approach, which not only ensure that the generation process accommodates tune patterns by controlling the rhythm and essential meaning of each sentence, but also allow the model to perform synchronous generation. In addition, we further improve our approach by applying reinforcement learning to the generation process with the rigid constraints of Ci as well as the diversity in content serving as rewards, so as to further maintain the format and content requirement. Experiments on a collected Ci dataset confirm that our proposed approach outperforms strong baselines and previous studies in terms of both automatic evaluation metrics and human judgements.
Anthology ID:
2022.emnlp-main.486
Volume:
Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing
Month:
December
Year:
2022
Address:
Abu Dhabi, United Arab Emirates
Editors:
Yoav Goldberg, Zornitsa Kozareva, Yue Zhang
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
7219–7229
Language:
URL:
https://aclanthology.org/2022.emnlp-main.486
DOI:
10.18653/v1/2022.emnlp-main.486
Bibkey:
Cite (ACL):
Yan Song. 2022. Composing Ci with Reinforced Non-autoregressive Text Generation. In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, pages 7219–7229, Abu Dhabi, United Arab Emirates. Association for Computational Linguistics.
Cite (Informal):
Composing Ci with Reinforced Non-autoregressive Text Generation (Song, EMNLP 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.emnlp-main.486.pdf