Rethinking Text Attribute Transfer: A Lexical Analysis

Yao Fu, Hao Zhou, Jiaze Chen, Lei Li


Abstract
Text attribute transfer is modifying certain linguistic attributes (e.g. sentiment, style, author-ship, etc.) of a sentence and transforming them from one type to another. In this paper, we aim to analyze and interpret what is changed during the transfer process. We start from the observation that in many existing models and datasets, certain words within a sentence play important roles in determining the sentence attribute class. These words are referred as the Pivot Words. Based on these pivot words, we propose a lexical analysis framework, the Pivot Analysis, to quantitatively analyze the effects of these words in text attribute classification and transfer. We apply this framework to existing datasets and models and show that: (1) the pivot words are strong features for the classification of sentence attributes; (2) to change the attribute of a sentence, many datasets only requires to change certain pivot words; (3) consequently, many transfer models only perform the lexical-level modification,while leaving higher-level sentence structures unchanged. Our work provides an in-depth understanding of linguistic attribute transfer and further identifies the future requirements and challenges of this task
Anthology ID:
W19-8604
Volume:
Proceedings of the 12th International Conference on Natural Language Generation
Month:
October–November
Year:
2019
Address:
Tokyo, Japan
Editors:
Kees van Deemter, Chenghua Lin, Hiroya Takamura
Venue:
INLG
SIG:
SIGGEN
Publisher:
Association for Computational Linguistics
Note:
Pages:
24–33
Language:
URL:
https://aclanthology.org/W19-8604
DOI:
10.18653/v1/W19-8604
Bibkey:
Cite (ACL):
Yao Fu, Hao Zhou, Jiaze Chen, and Lei Li. 2019. Rethinking Text Attribute Transfer: A Lexical Analysis. In Proceedings of the 12th International Conference on Natural Language Generation, pages 24–33, Tokyo, Japan. Association for Computational Linguistics.
Cite (Informal):
Rethinking Text Attribute Transfer: A Lexical Analysis (Fu et al., INLG 2019)
Copy Citation:
PDF:
https://aclanthology.org/W19-8604.pdf
Code
 FranxYao/pivot_analysis