End-to-end Learning of Logical Rules for Enhancing Document-level Relation Extraction

Kunxun Qi, Jianfeng Du, Hai Wan


Abstract
Document-level relation extraction (DocRE) aims to extract relations between entities in a whole document. One of the pivotal challenges of DocRE is to capture the intricate interdependencies between relations of entity pairs. Previous methods have shown that logical rules can explicitly help capture such interdependencies. These methods either learn logical rules to refine the output of a trained DocRE model, or first learn logical rules from annotated data and then inject the learnt rules into a DocRE model using an auxiliary training objective. However, these learning pipelines may suffer from the issue of error propagation. To mitigate this issue, we propose Joint Modeling Relation extraction and Logical rules or JMRL for short, a novel rule-based framework that jointly learns both a DocRE model and logical rules in an end-to-end fashion. Specifically, we parameterize a rule reasoning module in JMRL to simulate the inference of logical rules, thereby explicitly modeling the reasoning process. We also introduce an auxiliary loss and a residual connection mechanism in JMRL to better reconcile the DocRE model and the rule reasoning module. Experimental results on four benchmark datasets demonstrate that our proposed JMRL framework is consistently superior to existing rule-based frameworks, improving five baseline models for DocRE by a significant margin.
Anthology ID:
2024.acl-long.391
Volume:
Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
August
Year:
2024
Address:
Bangkok, Thailand
Editors:
Lun-Wei Ku, Andre Martins, Vivek Srikumar
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
7247–7263
Language:
URL:
https://aclanthology.org/2024.acl-long.391
DOI:
Bibkey:
Cite (ACL):
Kunxun Qi, Jianfeng Du, and Hai Wan. 2024. End-to-end Learning of Logical Rules for Enhancing Document-level Relation Extraction. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 7247–7263, Bangkok, Thailand. Association for Computational Linguistics.
Cite (Informal):
End-to-end Learning of Logical Rules for Enhancing Document-level Relation Extraction (Qi et al., ACL 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.acl-long.391.pdf