Mask and Regenerate: A Classifier-based Approach for Unpaired Sentiment Transformation of Reviews for Electronic Commerce Websites.

Shuo Yang


Abstract
Style transfer is the task of transferring a sentence into the target style while keeping its content. The major challenge is that parallel corpora are not available for various domains. In this paper, we propose a Mask-And-Regenerate approach (MAR). It learns from unpaired sentences by modifying the word-level style attributes. We cautiously integrate the deletion, insertion and substitution operations into our model. This enables our model to automatically apply different edit operations for different sentences. Specifically, we train a multilayer perceptron (MLP) as a style classifier to find out and mask style-characteristic words in the source inputs. Then we learn a language model on non-parallel data sets to score sentences and remove unnecessary masks. Finally, the masked source sentences are input to a Transformer to perform style transfer. The final results show that our proposed model exceeds baselines by about 2 per cent of accuracy for both sentiment and style transfer tasks with comparable or better content retention.
Anthology ID:
2022.socialnlp-1.1
Volume:
Proceedings of the Tenth International Workshop on Natural Language Processing for Social Media
Month:
July
Year:
2022
Address:
Seattle, Washington
Editors:
Lun-Wei Ku, Cheng-Te Li, Yu-Che Tsai, Wei-Yao Wang
Venue:
SocialNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1–10
Language:
URL:
https://aclanthology.org/2022.socialnlp-1.1
DOI:
10.18653/v1/2022.socialnlp-1.1
Bibkey:
Cite (ACL):
Shuo Yang. 2022. Mask and Regenerate: A Classifier-based Approach for Unpaired Sentiment Transformation of Reviews for Electronic Commerce Websites.. In Proceedings of the Tenth International Workshop on Natural Language Processing for Social Media, pages 1–10, Seattle, Washington. Association for Computational Linguistics.
Cite (Informal):
Mask and Regenerate: A Classifier-based Approach for Unpaired Sentiment Transformation of Reviews for Electronic Commerce Websites. (Yang, SocialNLP 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.socialnlp-1.1.pdf
Video:
 https://aclanthology.org/2022.socialnlp-1.1.mp4
Data
GYAFCIMDb Movie Reviews