A Simple yet Effective Relation Information Guided Approach for Few-Shot Relation Extraction

Yang Liu, Jinpeng Hu, Xiang Wan, Tsung-Hui Chang


Abstract
Few-Shot Relation Extraction aims at predicting the relation for a pair of entities in a sentence by training with a few labelled examples in each relation. Some recent works have introduced relation information (i.e., relation labels or descriptions) to assist model learning based on Prototype Network. However, most of them constrain the prototypes of each relation class implicitly with relation information, generally through designing complex network structures, like generating hybrid features, combining with contrastive learning or attention networks. We argue that relation information can be introduced more explicitly and effectively into the model. Thus, this paper proposes a direct addition approach to introduce relation information. Specifically, for each relation class, the relation representation is first generated by concatenating two views of relations (i.e., [CLS] token embedding and the mean value of embeddings of all tokens) and then directly added to the original prototype for both train and prediction. Experimental results on the benchmark dataset FewRel 1.0 show significant improvements and achieve comparable results to the state-of-the-art, which demonstrates the effectiveness of our proposed approach. Besides, further analyses verify that the direct addition is a much more effective way to integrate the relation representations and the original prototypes.
Anthology ID:
2022.findings-acl.62
Volume:
Findings of the Association for Computational Linguistics: ACL 2022
Month:
May
Year:
2022
Address:
Dublin, Ireland
Editors:
Smaranda Muresan, Preslav Nakov, Aline Villavicencio
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
757–763
Language:
URL:
https://aclanthology.org/2022.findings-acl.62
DOI:
10.18653/v1/2022.findings-acl.62
Bibkey:
Cite (ACL):
Yang Liu, Jinpeng Hu, Xiang Wan, and Tsung-Hui Chang. 2022. A Simple yet Effective Relation Information Guided Approach for Few-Shot Relation Extraction. In Findings of the Association for Computational Linguistics: ACL 2022, pages 757–763, Dublin, Ireland. Association for Computational Linguistics.
Cite (Informal):
A Simple yet Effective Relation Information Guided Approach for Few-Shot Relation Extraction (Liu et al., Findings 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.findings-acl.62.pdf
Software:
 2022.findings-acl.62.software.zip
Code
 lylylylylyly/simplefsre
Data
FewRel