Painsight: An Extendable Opinion Mining Framework for Detecting Pain Points Based on Online Customer Reviews

Yukyung Lee, Jaehee Kim, Doyoon Kim, Yookyung Kho, Younsun Kim, Pilsung Kang


Abstract
As the e-commerce market continues to expand and online transactions proliferate, customer reviews have emerged as a critical element in shaping the purchasing decisions of prospective buyers. Previous studies have endeavored to identify key aspects of customer reviews through the development of sentiment analysis models and topic models. However, extracting specific dissatisfaction factors remains a challenging task. In this study, we delineate the pain point detection problem and propose Painsight, an unsupervised framework for automatically extracting distinct dissatisfaction factors from customer reviews without relying on ground truth labels. Painsight employs pre-trained language models to construct sentiment analysis and topic models, leveraging attribution scores derived from model gradients to extract dissatisfaction factors. Upon application of the proposed methodology to customer review data spanning five product categories, we successfully identified and categorized dissatisfaction factors within each group, as well as isolated factors for each type. Notably, Painsight outperformed benchmark methods, achieving substantial performance enhancements and exceptional results in human evaluations.
Anthology ID:
2023.wassa-1.20
Volume:
Proceedings of the 13th Workshop on Computational Approaches to Subjectivity, Sentiment, & Social Media Analysis
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Jeremy Barnes, Orphée De Clercq, Roman Klinger
Venue:
WASSA
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
215–227
Language:
URL:
https://aclanthology.org/2023.wassa-1.20
DOI:
10.18653/v1/2023.wassa-1.20
Bibkey:
Cite (ACL):
Yukyung Lee, Jaehee Kim, Doyoon Kim, Yookyung Kho, Younsun Kim, and Pilsung Kang. 2023. Painsight: An Extendable Opinion Mining Framework for Detecting Pain Points Based on Online Customer Reviews. In Proceedings of the 13th Workshop on Computational Approaches to Subjectivity, Sentiment, & Social Media Analysis, pages 215–227, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
Painsight: An Extendable Opinion Mining Framework for Detecting Pain Points Based on Online Customer Reviews (Lee et al., WASSA 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.wassa-1.20.pdf
Video:
 https://aclanthology.org/2023.wassa-1.20.mp4