A Cognition Based Attention Model for Sentiment Analysis

Yunfei Long, Qin Lu, Rong Xiang, Minglei Li, Chu-Ren Huang


Abstract
Attention models are proposed in sentiment analysis because some words are more important than others. However,most existing methods either use local context based text information or user preference information. In this work, we propose a novel attention model trained by cognition grounded eye-tracking data. A reading prediction model is first built using eye-tracking data as dependent data and other features in the context as independent data. The predicted reading time is then used to build a cognition based attention (CBA) layer for neural sentiment analysis. As a comprehensive model, We can capture attentions of words in sentences as well as sentences in documents. Different attention mechanisms can also be incorporated to capture other aspects of attentions. Evaluations show the CBA based method outperforms the state-of-the-art local context based attention methods significantly. This brings insight to how cognition grounded data can be brought into NLP tasks.
Anthology ID:
D17-1048
Volume:
Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing
Month:
September
Year:
2017
Address:
Copenhagen, Denmark
Editors:
Martha Palmer, Rebecca Hwa, Sebastian Riedel
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
462–471
Language:
URL:
https://aclanthology.org/D17-1048
DOI:
10.18653/v1/D17-1048
Bibkey:
Cite (ACL):
Yunfei Long, Qin Lu, Rong Xiang, Minglei Li, and Chu-Ren Huang. 2017. A Cognition Based Attention Model for Sentiment Analysis. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing, pages 462–471, Copenhagen, Denmark. Association for Computational Linguistics.
Cite (Informal):
A Cognition Based Attention Model for Sentiment Analysis (Long et al., EMNLP 2017)
Copy Citation:
PDF:
https://aclanthology.org/D17-1048.pdf
Data
IMDb Movie Reviews