An Iteratively Parallel Generation Method with the Pre-Filling Strategy for Document-level Event Extraction

Guanhua Huang, Runxin Xu, Ying Zeng, Jiaze Chen, Zhouwang Yang, Weinan E


Abstract
In document-level event extraction (DEE) tasks, a document typically contains many event records with multiple event roles. Therefore, accurately extracting all event records is a big challenge since the number of event records is not given. Previous works present the entity-based directed acyclic graph (EDAG) generation methods to autoregressively generate event roles, which requires a given generation order. Meanwhile, parallel methods are proposed to generate all event roles simultaneously, but suffer from the inadequate training which manifests zero accuracies on some event roles. In this paper, we propose an Iteratively Parallel Generation method with the Pre-Filling strategy (IPGPF). Event roles in an event record are generated in parallel to avoid order selection, and the event records are iteratively generated to utilize historical results. Experiments on two public datasets show our IPGPF improves 11.7 F1 than previous parallel models and up to 5.1 F1 than auto-regressive models under the control variable settings. Moreover, our enhanced IPGPF outperforms other entity-enhanced models and achieves new state-of-the-art performance.
Anthology ID:
2023.emnlp-main.668
Volume:
Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing
Month:
December
Year:
2023
Address:
Singapore
Editors:
Houda Bouamor, Juan Pino, Kalika Bali
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
10834–10852
Language:
URL:
https://aclanthology.org/2023.emnlp-main.668
DOI:
10.18653/v1/2023.emnlp-main.668
Bibkey:
Cite (ACL):
Guanhua Huang, Runxin Xu, Ying Zeng, Jiaze Chen, Zhouwang Yang, and Weinan E. 2023. An Iteratively Parallel Generation Method with the Pre-Filling Strategy for Document-level Event Extraction. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 10834–10852, Singapore. Association for Computational Linguistics.
Cite (Informal):
An Iteratively Parallel Generation Method with the Pre-Filling Strategy for Document-level Event Extraction (Huang et al., EMNLP 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.emnlp-main.668.pdf
Video:
 https://aclanthology.org/2023.emnlp-main.668.mp4