FSUIE: A Novel Fuzzy Span Mechanism for Universal Information Extraction

Tianshuo Peng, Zuchao Li, Lefei Zhang, Bo Du, Hai Zhao


Abstract
Universal Information Extraction (UIE) has been introduced as a unified framework for various Information Extraction (IE) tasks and has achieved widespread success. Despite this, UIE models have limitations. For example, they rely heavily on span boundaries in the data during training, which does not reflect the reality of span annotation challenges. Slight adjustments to positions can also meet requirements. Additionally, UIE models lack attention to the limited span length feature in IE. To address these deficiencies, we propose the Fuzzy Span Universal Information Extraction (FSUIE) framework. Specifically, our contribution consists of two concepts: fuzzy span loss and fuzzy span attention. Our experimental results on a series of main IE tasks show significant improvement compared to the baseline, especially in terms of fast convergence and strong performance with small amounts of data and training epochs. These results demonstrate the effectiveness and generalization of FSUIE in different tasks, settings, and scenarios.
Anthology ID:
2023.acl-long.902
Volume:
Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Anna Rogers, Jordan Boyd-Graber, Naoaki Okazaki
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
16318–16333
Language:
URL:
https://aclanthology.org/2023.acl-long.902
DOI:
10.18653/v1/2023.acl-long.902
Bibkey:
Cite (ACL):
Tianshuo Peng, Zuchao Li, Lefei Zhang, Bo Du, and Hai Zhao. 2023. FSUIE: A Novel Fuzzy Span Mechanism for Universal Information Extraction. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 16318–16333, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
FSUIE: A Novel Fuzzy Span Mechanism for Universal Information Extraction (Peng et al., ACL 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.acl-long.902.pdf
Video:
 https://aclanthology.org/2023.acl-long.902.mp4