Multi-Pair Text Style Transfer for Unbalanced Data via Task-Adaptive Meta-Learning

Xing Han, Jessica Lundin


Abstract
Text-style transfer aims to convert text given in one domain into another by paraphrasing the sentence or substituting the keywords without altering the content. By necessity, state-of-the-art methods have evolved to accommodate nonparallel training data, as it is frequently the case there are multiple data sources of unequal size, with a mixture of labeled and unlabeled sentences. Moreover, the inherent style defined within each source might be distinct. A generic bidirectional (e.g., formal informal) style transfer regardless of different groups may not generalize well to different applications. In this work, we developed a task adaptive meta-learning framework that can simultaneously perform a multi-pair text-style transfer using a single model. The proposed method can adaptively balance the difference of meta-knowledge across multiple tasks. Results show that our method leads to better quantitative performance as well as coherent style variations. Common challenges of unbalanced data and mismatched domains are handled well by this method.
Anthology ID:
2021.metanlp-1.4
Volume:
Proceedings of the 1st Workshop on Meta Learning and Its Applications to Natural Language Processing
Month:
August
Year:
2021
Address:
Online
Editors:
Hung-Yi Lee, Mitra Mohtarami, Shang-Wen Li, Di Jin, Mandy Korpusik, Shuyan Dong, Ngoc Thang Vu, Dilek Hakkani-Tur
Venue:
MetaNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
28–35
Language:
URL:
https://aclanthology.org/2021.metanlp-1.4
DOI:
10.18653/v1/2021.metanlp-1.4
Bibkey:
Cite (ACL):
Xing Han and Jessica Lundin. 2021. Multi-Pair Text Style Transfer for Unbalanced Data via Task-Adaptive Meta-Learning. In Proceedings of the 1st Workshop on Meta Learning and Its Applications to Natural Language Processing, pages 28–35, Online. Association for Computational Linguistics.
Cite (Informal):
Multi-Pair Text Style Transfer for Unbalanced Data via Task-Adaptive Meta-Learning (Han & Lundin, MetaNLP 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.metanlp-1.4.pdf