Knowledge-Enriched Two-Layered Attention Network for Sentiment Analysis

Abhishek Kumar, Daisuke Kawahara, Sadao Kurohashi


Abstract
We propose a novel two-layered attention network based on Bidirectional Long Short-Term Memory for sentiment analysis. The novel two-layered attention network takes advantage of the external knowledge bases to improve the sentiment prediction. It uses the Knowledge Graph Embedding generated using the WordNet. We build our model by combining the two-layered attention network with the supervised model based on Support Vector Regression using a Multilayer Perceptron network for sentiment analysis. We evaluate our model on the benchmark dataset of SemEval 2017 Task 5. Experimental results show that the proposed model surpasses the top system of SemEval 2017 Task 5. The model performs significantly better by improving the state-of-the-art system at SemEval 2017 Task 5 by 1.7 and 3.7 points for sub-tracks 1 and 2 respectively.
Anthology ID:
N18-2041
Volume:
Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers)
Month:
June
Year:
2018
Address:
New Orleans, Louisiana
Editors:
Marilyn Walker, Heng Ji, Amanda Stent
Venue:
NAACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
253–258
Language:
URL:
https://aclanthology.org/N18-2041
DOI:
10.18653/v1/N18-2041
Bibkey:
Cite (ACL):
Abhishek Kumar, Daisuke Kawahara, and Sadao Kurohashi. 2018. Knowledge-Enriched Two-Layered Attention Network for Sentiment Analysis. In Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 2 (Short Papers), pages 253–258, New Orleans, Louisiana. Association for Computational Linguistics.
Cite (Informal):
Knowledge-Enriched Two-Layered Attention Network for Sentiment Analysis (Kumar et al., NAACL 2018)
Copy Citation:
PDF:
https://aclanthology.org/N18-2041.pdf