Learning to Paraphrase Sentences to Different Complexity Levels

Alison Chi, Li-Kuang Chen, Yi-Chen Chang, Shu-Hui Lee, Jason S. Chang


Abstract
While sentence simplification is an active research topic in NLP, its adjacent tasks of sentence complexification and same-level paraphrasing are not. To train models on all three tasks, we present two new unsupervised datasets. We compare these datasets, one labeled by a weak classifier and the other by a rule-based approach, with a single supervised dataset. Using these three datasets for training, we perform extensive experiments on both multitasking and prompting strategies. Compared to other systems trained on unsupervised parallel data, models trained on our weak classifier labeled dataset achieve state-of-the-art performance on the ASSET simplification benchmark. Our models also outperform previous work on sentence-level targeting. Finally, we establish how a handful of Large Language Models perform on these tasks under a zero-shot setting.
Anthology ID:
2023.tacl-1.76
Volume:
Transactions of the Association for Computational Linguistics, Volume 11
Month:
Year:
2023
Address:
Cambridge, MA
Venue:
TACL
SIG:
Publisher:
MIT Press
Note:
Pages:
1332–1354
Language:
URL:
https://aclanthology.org/2023.tacl-1.76
DOI:
10.1162/tacl_a_00606
Bibkey:
Cite (ACL):
Alison Chi, Li-Kuang Chen, Yi-Chen Chang, Shu-Hui Lee, and Jason S. Chang. 2023. Learning to Paraphrase Sentences to Different Complexity Levels. Transactions of the Association for Computational Linguistics, 11:1332–1354.
Cite (Informal):
Learning to Paraphrase Sentences to Different Complexity Levels (Chi et al., TACL 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.tacl-1.76.pdf
Video:
 https://aclanthology.org/2023.tacl-1.76.mp4