Graph-based Model Generation for Few-Shot Relation Extraction

Wanli Li, Tieyun Qian


Abstract
Few-shot relation extraction (FSRE) has been a challenging problem since it only has a handful of training instances. Existing models follow a ‘one-for-all’ scheme where one general large model performs all individual N-way-K-shot tasks in FSRE, which prevents the model from achieving the optimal point on each task. In view of this, we propose a model generation framework that consists of one general model for all tasks and many tiny task-specific models for each individual task. The general model generates and passes the universal knowledge to the tiny models which will be further fine-tuned when performing specific tasks. In this way, we decouple the complexity of the entire task space from that of all individual tasks while absorbing the universal knowledge. Extensive experimental results on two public datasets demonstrate that our framework reaches a new state-of-the-art performance for FRSE tasks. Our code is available at: https://github.com/NLPWM-WHU/GM_GEN.
Anthology ID:
2022.emnlp-main.5
Volume:
Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing
Month:
December
Year:
2022
Address:
Abu Dhabi, United Arab Emirates
Editors:
Yoav Goldberg, Zornitsa Kozareva, Yue Zhang
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
62–71
Language:
URL:
https://aclanthology.org/2022.emnlp-main.5
DOI:
10.18653/v1/2022.emnlp-main.5
Bibkey:
Cite (ACL):
Wanli Li and Tieyun Qian. 2022. Graph-based Model Generation for Few-Shot Relation Extraction. In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, pages 62–71, Abu Dhabi, United Arab Emirates. Association for Computational Linguistics.
Cite (Informal):
Graph-based Model Generation for Few-Shot Relation Extraction (Li & Qian, EMNLP 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.emnlp-main.5.pdf