A Hierarchical VAE for Calibrating Attributes while Generating Text using Normalizing Flow

Bidisha Samanta, Mohit Agrawal, NIloy Ganguly


Abstract
In this digital age, online users expect personalized content. To cater to diverse group of audiences across online platforms it is necessary to generate multiple variants of same content with differing degree of characteristics (sentiment, style, formality, etc.). Though text-style transfer is a well explored related area, it focuses on flipping the style attribute polarity instead of regulating a fine-grained attribute transfer. In this paper we propose a hierarchical architecture for finer control over the at- tribute, preserving content using attribute dis- entanglement. We demonstrate the effective- ness of the generative process for two different attributes with varied complexity, namely sentiment and formality. With extensive experiments and human evaluation on five real-world datasets, we show that the framework can generate natural looking sentences with finer degree of control of intensity of a given attribute.
Anthology ID:
2021.acl-long.187
Volume:
Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers)
Month:
August
Year:
2021
Address:
Online
Editors:
Chengqing Zong, Fei Xia, Wenjie Li, Roberto Navigli
Venues:
ACL | IJCNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
2405–2415
Language:
URL:
https://aclanthology.org/2021.acl-long.187
DOI:
10.18653/v1/2021.acl-long.187
Bibkey:
Cite (ACL):
Bidisha Samanta, Mohit Agrawal, and NIloy Ganguly. 2021. A Hierarchical VAE for Calibrating Attributes while Generating Text using Normalizing Flow. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), pages 2405–2415, Online. Association for Computational Linguistics.
Cite (Informal):
A Hierarchical VAE for Calibrating Attributes while Generating Text using Normalizing Flow (Samanta et al., ACL-IJCNLP 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.acl-long.187.pdf
Video:
 https://aclanthology.org/2021.acl-long.187.mp4