Element Intervention for Open Relation Extraction

Fangchao Liu, Lingyong Yan, Hongyu Lin, Xianpei Han, Le Sun


Abstract
Open relation extraction aims to cluster relation instances referring to the same underlying relation, which is a critical step for general relation extraction. Current OpenRE models are commonly trained on the datasets generated from distant supervision, which often results in instability and makes the model easily collapsed. In this paper, we revisit the procedure of OpenRE from a causal view. By formulating OpenRE using a structural causal model, we identify that the above-mentioned problems stem from the spurious correlations from entities and context to the relation type. To address this issue, we conduct Element Intervention, which intervene on the context and entities respectively to obtain the underlying causal effects of them. We also provide two specific implementations of the interventions based on entity ranking and context contrasting. Experimental results on unsupervised relation extraction datasets show our method to outperform previous state-of-the-art methods and is robust across different datasets.
Anthology ID:
2021.acl-long.361
Original:
2021.acl-long.361v1
Version 2:
2021.acl-long.361v2
Volume:
Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers)
Month:
August
Year:
2021
Address:
Online
Editors:
Chengqing Zong, Fei Xia, Wenjie Li, Roberto Navigli
Venues:
ACL | IJCNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
4683–4693
Language:
URL:
https://aclanthology.org/2021.acl-long.361
DOI:
10.18653/v1/2021.acl-long.361
Bibkey:
Cite (ACL):
Fangchao Liu, Lingyong Yan, Hongyu Lin, Xianpei Han, and Le Sun. 2021. Element Intervention for Open Relation Extraction. In Proceedings of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), pages 4683–4693, Online. Association for Computational Linguistics.
Cite (Informal):
Element Intervention for Open Relation Extraction (Liu et al., ACL-IJCNLP 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.acl-long.361.pdf
Video:
 https://aclanthology.org/2021.acl-long.361.mp4
Data
T-REx