Modeling Complex Interactions in Long Documents for Aspect-Based Sentiment Analysis

Zehong Yan, Wynne Hsu, Mong-Li Lee, David Bartram-Shaw


Abstract
The growing number of online articles and reviews necessitates innovative techniques for document-level aspect-based sentiment analysis. Capturing the context in which an aspect is mentioned is crucial. Existing models have focused on relatively short reviews and may fail to consider distant contextual information. This is especially so in longer documents where an aspect may be referred to in multiple ways across dispersed sentences. This work introduces a hierarchical Transformer-based architecture that encodes information at different level of granularities with attention aggregation mechanisms to learn the local and global aspect-specific document representations. For empirical validation, we curate two datasets of long documents: one on social issues, and another covering various topics involving trust-related issues. Experimental results show that the proposed architecture outperforms state-of-the-art methods for document-level aspect-based sentiment classification. We also demonstrate the potential applicability of our approach for long document trust prediction.
Anthology ID:
2024.wassa-1.3
Volume:
Proceedings of the 14th Workshop on Computational Approaches to Subjectivity, Sentiment, & Social Media Analysis
Month:
August
Year:
2024
Address:
Bangkok, Thailand
Editors:
Orphée De Clercq, Valentin Barriere, Jeremy Barnes, Roman Klinger, João Sedoc, Shabnam Tafreshi
Venues:
WASSA | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
23–34
Language:
URL:
https://aclanthology.org/2024.wassa-1.3
DOI:
10.18653/v1/2024.wassa-1.3
Bibkey:
Cite (ACL):
Zehong Yan, Wynne Hsu, Mong-Li Lee, and David Bartram-Shaw. 2024. Modeling Complex Interactions in Long Documents for Aspect-Based Sentiment Analysis. In Proceedings of the 14th Workshop on Computational Approaches to Subjectivity, Sentiment, & Social Media Analysis, pages 23–34, Bangkok, Thailand. Association for Computational Linguistics.
Cite (Informal):
Modeling Complex Interactions in Long Documents for Aspect-Based Sentiment Analysis (Yan et al., WASSA-WS 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.wassa-1.3.pdf