Joint Entity and Relation Extraction Based on Table Labeling Using Convolutional Neural Networks

Youmi Ma, Tatsuya Hiraoka, Naoaki Okazaki


Abstract
This study introduces a novel approach to the joint extraction of entities and relations by stacking convolutional neural networks (CNNs) on pretrained language models. We adopt table representations to model the entities and relations, casting the entity and relation extraction as a table-labeling problem. Regarding each table as an image and each cell in a table as an image pixel, we apply two-dimensional CNNs to the tables to capture local dependencies and predict the cell labels. The experimental results showed that the performance of the proposed method is comparable to those of current state-of-art systems on the CoNLL04, ACE05, and ADE datasets. Even when freezing pretrained language model parameters, the proposed method showed a stable performance, whereas the compared methods suffered from significant decreases in performance. This observation indicates that the parameters of the pretrained encoder may incorporate dependencies among the entity and relation labels during fine-tuning.
Anthology ID:
2022.spnlp-1.2
Volume:
Proceedings of the Sixth Workshop on Structured Prediction for NLP
Month:
May
Year:
2022
Address:
Dublin, Ireland
Editors:
Andreas Vlachos, Priyanka Agrawal, André Martins, Gerasimos Lampouras, Chunchuan Lyu
Venue:
spnlp
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
11–21
Language:
URL:
https://aclanthology.org/2022.spnlp-1.2
DOI:
10.18653/v1/2022.spnlp-1.2
Bibkey:
Cite (ACL):
Youmi Ma, Tatsuya Hiraoka, and Naoaki Okazaki. 2022. Joint Entity and Relation Extraction Based on Table Labeling Using Convolutional Neural Networks. In Proceedings of the Sixth Workshop on Structured Prediction for NLP, pages 11–21, Dublin, Ireland. Association for Computational Linguistics.
Cite (Informal):
Joint Entity and Relation Extraction Based on Table Labeling Using Convolutional Neural Networks (Ma et al., spnlp 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.spnlp-1.2.pdf
Video:
 https://aclanthology.org/2022.spnlp-1.2.mp4
Code
 youmima/tablert-cnn