DREEAM: Guiding Attention with Evidence for Improving Document-Level Relation Extraction

Youmi Ma, An Wang, Naoaki Okazaki


Abstract
Document-level relation extraction (DocRE) is the task of identifying all relations between each entity pair in a document. Evidence, defined as sentences containing clues for the relationship between an entity pair, has been shown to help DocRE systems focus on relevant texts, thus improving relation extraction. However, evidence retrieval (ER) in DocRE faces two major issues: high memory consumption and limited availability of annotations. This work aims at addressing these issues to improve the usage of ER in DocRE. First, we propose DREEAM, a memory-efficient approach that adopts evidence information as the supervisory signal, thereby guiding the attention modules of the DocRE system to assign high weights to evidence. Second, we propose a self-training strategy for DREEAM to learn ER from automatically-generated evidence on massive data without evidence annotations. Experimental results reveal that our approach exhibits state-of-the-art performance on the DocRED benchmark for both DocRE and ER. To the best of our knowledge, DREEAM is the first approach to employ ER self-training.
Anthology ID:
2023.eacl-main.145
Volume:
Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics
Month:
May
Year:
2023
Address:
Dubrovnik, Croatia
Editors:
Andreas Vlachos, Isabelle Augenstein
Venue:
EACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1971–1983
Language:
URL:
https://aclanthology.org/2023.eacl-main.145
DOI:
10.18653/v1/2023.eacl-main.145
Bibkey:
Cite (ACL):
Youmi Ma, An Wang, and Naoaki Okazaki. 2023. DREEAM: Guiding Attention with Evidence for Improving Document-Level Relation Extraction. In Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics, pages 1971–1983, Dubrovnik, Croatia. Association for Computational Linguistics.
Cite (Informal):
DREEAM: Guiding Attention with Evidence for Improving Document-Level Relation Extraction (Ma et al., EACL 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.eacl-main.145.pdf
Software:
 2023.eacl-main.145.software.zip
Video:
 https://aclanthology.org/2023.eacl-main.145.mp4