Better Few-Shot Relation Extraction with Label Prompt Dropout

Peiyuan Zhang, Wei Lu


Abstract
Few-shot relation extraction aims to learn to identify the relation between two entities based on very limited training examples. Recent efforts found that textual labels (i.e., relation names and relation descriptions) could be extremely useful for learning class representations, which will benefit the few-shot learning task. However, what is the best way to leverage such label information in the learning process is an important research question. Existing works largely assume such textual labels are always present during both learning and prediction. In this work, we argue that such approaches may not always lead to optimal results. Instead, we present a novel approach called label prompt dropout, which randomly removes label descriptions in the learning process. Our experiments show that our approach is able to lead to improved class representations, yielding significantly better results on the few-shot relation extraction task.
Anthology ID:
2022.emnlp-main.471
Volume:
Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing
Month:
December
Year:
2022
Address:
Abu Dhabi, United Arab Emirates
Editors:
Yoav Goldberg, Zornitsa Kozareva, Yue Zhang
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
6996–7006
Language:
URL:
https://aclanthology.org/2022.emnlp-main.471
DOI:
10.18653/v1/2022.emnlp-main.471
Bibkey:
Cite (ACL):
Peiyuan Zhang and Wei Lu. 2022. Better Few-Shot Relation Extraction with Label Prompt Dropout. In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, pages 6996–7006, Abu Dhabi, United Arab Emirates. Association for Computational Linguistics.
Cite (Informal):
Better Few-Shot Relation Extraction with Label Prompt Dropout (Zhang & Lu, EMNLP 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.emnlp-main.471.pdf