Unsupervised Opinion Summarization Using Approximate Geodesics

Somnath Basu Roy Chowdhury, Nicholas Monath, Kumar Dubey, Amr Ahmed, Snigdha Chaturvedi


Abstract
Opinion summarization is the task of creating summaries capturing popular opinions from user reviews.In this paper, we introduce Geodesic Summarizer (GeoSumm), a novel system to perform unsupervised extractive opinion summarization. GeoSumm consists of an encoder-decoder based representation learning model that generates topical representations of texts. These representations capture the underlying semantics of the text as a distribution over learnable latent units. GeoSumm generates these topical representations by performing dictionary learning over pre-trained text representations at multiple layers of the decoder. We then use these topical representations to quantify the importance of review sentences using a novel approximate geodesic distance-based scoring mechanism. We use the importance scores to identify popular opinions in order to compose general and aspect-specific summaries. Our proposed model, GeoSumm, achieves strong performance on three opinion summarization datasets. We perform additional experiments to analyze the functioning of our model and showcase the generalization ability of GeoSumm across different domains.
Anthology ID:
2023.newsum-1.11
Volume:
Proceedings of the 4th New Frontiers in Summarization Workshop
Month:
December
Year:
2023
Address:
Singapore
Editors:
Yue Dong, Wen Xiao, Lu Wang, Fei Liu, Giuseppe Carenini
Venue:
NewSum
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
105–120
Language:
URL:
https://aclanthology.org/2023.newsum-1.11
DOI:
10.18653/v1/2023.newsum-1.11
Bibkey:
Cite (ACL):
Somnath Basu Roy Chowdhury, Nicholas Monath, Kumar Dubey, Amr Ahmed, and Snigdha Chaturvedi. 2023. Unsupervised Opinion Summarization Using Approximate Geodesics. In Proceedings of the 4th New Frontiers in Summarization Workshop, pages 105–120, Singapore. Association for Computational Linguistics.
Cite (Informal):
Unsupervised Opinion Summarization Using Approximate Geodesics (Basu Roy Chowdhury et al., NewSum 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.newsum-1.11.pdf
Supplementary material:
 2023.newsum-1.11.SupplementaryMaterial.txt
Video:
 https://aclanthology.org/2023.newsum-1.11.mp4