Attention-Based Convolutional Neural Network for Semantic Relation Extraction

Yatian Shen, Xuanjing Huang


Abstract
Nowadays, neural networks play an important role in the task of relation classification. In this paper, we propose a novel attention-based convolutional neural network architecture for this task. Our model makes full use of word embedding, part-of-speech tag embedding and position embedding information. Word level attention mechanism is able to better determine which parts of the sentence are most influential with respect to the two entities of interest. This architecture enables learning some important features from task-specific labeled data, forgoing the need for external knowledge such as explicit dependency structures. Experiments on the SemEval-2010 Task 8 benchmark dataset show that our model achieves better performances than several state-of-the-art neural network models and can achieve a competitive performance just with minimal feature engineering.
Anthology ID:
C16-1238
Volume:
Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers
Month:
December
Year:
2016
Address:
Osaka, Japan
Editors:
Yuji Matsumoto, Rashmi Prasad
Venue:
COLING
SIG:
Publisher:
The COLING 2016 Organizing Committee
Note:
Pages:
2526–2536
Language:
URL:
https://aclanthology.org/C16-1238
DOI:
Bibkey:
Cite (ACL):
Yatian Shen and Xuanjing Huang. 2016. Attention-Based Convolutional Neural Network for Semantic Relation Extraction. In Proceedings of COLING 2016, the 26th International Conference on Computational Linguistics: Technical Papers, pages 2526–2536, Osaka, Japan. The COLING 2016 Organizing Committee.
Cite (Informal):
Attention-Based Convolutional Neural Network for Semantic Relation Extraction (Shen & Huang, COLING 2016)
Copy Citation:
PDF:
https://aclanthology.org/C16-1238.pdf
Data
SemEval-2010 Task-8