How Positive Are You: Text Style Transfer using Adaptive Style Embedding

Heejin Kim, Kyung-Ah Sohn


Abstract
The prevalent approach for unsupervised text style transfer is disentanglement between content and style. However, it is difficult to completely separate style information from the content. Other approaches allow the latent text representation to contain style and the target style to affect the generated output more than the latent representation does. In both approaches, however, it is impossible to adjust the strength of the style in the generated output. Moreover, those previous approaches typically perform both the sentence reconstruction and style control tasks in a single model, which complicates the overall architecture. In this paper, we address these issues by separating the model into a sentence reconstruction module and a style module. We use the Transformer-based autoencoder model for sentence reconstruction and the adaptive style embedding is learned directly in the style module. Because of this separation, each module can better focus on its own task. Moreover, we can vary the style strength of the generated sentence by changing the style of the embedding expression. Therefore, our approach not only controls the strength of the style, but also simplifies the model architecture. Experimental results show that our approach achieves better style transfer performance and content preservation than previous approaches.
Anthology ID:
2020.coling-main.191
Volume:
Proceedings of the 28th International Conference on Computational Linguistics
Month:
December
Year:
2020
Address:
Barcelona, Spain (Online)
Editors:
Donia Scott, Nuria Bel, Chengqing Zong
Venue:
COLING
SIG:
Publisher:
International Committee on Computational Linguistics
Note:
Pages:
2115–2125
Language:
URL:
https://aclanthology.org/2020.coling-main.191
DOI:
10.18653/v1/2020.coling-main.191
Bibkey:
Cite (ACL):
Heejin Kim and Kyung-Ah Sohn. 2020. How Positive Are You: Text Style Transfer using Adaptive Style Embedding. In Proceedings of the 28th International Conference on Computational Linguistics, pages 2115–2125, Barcelona, Spain (Online). International Committee on Computational Linguistics.
Cite (Informal):
How Positive Are You: Text Style Transfer using Adaptive Style Embedding (Kim & Sohn, COLING 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.coling-main.191.pdf
Code
 kinggodhj/how-positive-are-you-text-style-transfer-using-adaptive-style-embedding