Weakly-Supervised Questions for Zero-Shot Relation Extraction

Saeed Najafi, Alona Fyshe


Abstract
Zero-Shot Relation Extraction (ZRE) is the task of Relation Extraction where the training and test sets have no shared relation types. This very challenging domain is a good test of a model’s ability to generalize. Previous approaches to ZRE reframed relation extraction as Question Answering (QA), allowing for the use of pre-trained QA models. However, this method required manually creating gold question templates for each new relation. Here, we do away with these gold templates and instead learn a model that can generate questions for unseen relations. Our technique can successfully translate relation descriptions into relevant questions, which are then leveraged to generate the correct tail entity. On tail entity extraction, we outperform the previous state-of-the-art by more than 16 F1 points without using gold question templates. On the RE-QA dataset where no previous baseline for relation extraction exists, our proposed algorithm comes within 0.7 F1 points of a system that uses gold question templates. Our model also outperforms the state-of-the-art ZRE baselines on the FewRel and WikiZSL datasets, showing that QA models no longer need template questions to match the performance of models specifically tailored to the ZRE task. Our implementation is available at https://github.com/fyshelab/QA-ZRE.
Anthology ID:
2023.eacl-main.224
Volume:
Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics
Month:
May
Year:
2023
Address:
Dubrovnik, Croatia
Editors:
Andreas Vlachos, Isabelle Augenstein
Venue:
EACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
3075–3087
Language:
URL:
https://aclanthology.org/2023.eacl-main.224
DOI:
10.18653/v1/2023.eacl-main.224
Bibkey:
Cite (ACL):
Saeed Najafi and Alona Fyshe. 2023. Weakly-Supervised Questions for Zero-Shot Relation Extraction. In Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics, pages 3075–3087, Dubrovnik, Croatia. Association for Computational Linguistics.
Cite (Informal):
Weakly-Supervised Questions for Zero-Shot Relation Extraction (Najafi & Fyshe, EACL 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.eacl-main.224.pdf
Video:
 https://aclanthology.org/2023.eacl-main.224.mp4