Text Generation Model Enhanced with Semantic Information in Aspect Category Sentiment Analysis

Tu Tran, Kiyoaki Shirai, Natthawut Kertkeidkachorn


Abstract
Aspect Category Sentiment Analysis (ACSA) is one of the main subtasks of sentiment analysis, which aims at predicting polarity over a given aspect category. Recently, generative methods emerge as an efficient way to utilize a pre-trained language model for solving ACSA. However, those methods fail to model relations of target words and opinion words in a sentence including multiple aspects. To tackle this problem, this paper proposes a method to incorporate Abstract Meaning Representation (AMR), which describes semantic representation of a sentence as a directed graph, into a text generation model. Furthermore, two regularizers are designed to guide cross attention weights allocation over AMR graphs. One is the identical regularizer that constrains attention weights of aligned nodes, the other is the entropy regularizer that helps the decoder generate tokens by heavily considering only a few related nodes in the AMR graph. Experimental results on three datasets show that the proposed method outperforms state-of-the-art methods, proving the effectiveness of our model.
Anthology ID:
2023.findings-acl.323
Volume:
Findings of the Association for Computational Linguistics: ACL 2023
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Anna Rogers, Jordan Boyd-Graber, Naoaki Okazaki
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
5256–5268
Language:
URL:
https://aclanthology.org/2023.findings-acl.323
DOI:
10.18653/v1/2023.findings-acl.323
Bibkey:
Cite (ACL):
Tu Tran, Kiyoaki Shirai, and Natthawut Kertkeidkachorn. 2023. Text Generation Model Enhanced with Semantic Information in Aspect Category Sentiment Analysis. In Findings of the Association for Computational Linguistics: ACL 2023, pages 5256–5268, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
Text Generation Model Enhanced with Semantic Information in Aspect Category Sentiment Analysis (Tran et al., Findings 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.findings-acl.323.pdf
Video:
 https://aclanthology.org/2023.findings-acl.323.mp4