Few-shot Learning for Slot Tagging with Attentive Relational Network

Cennet Oguz, Ngoc Thang Vu


Abstract
Metric-based learning is a well-known family of methods for few-shot learning, especially in computer vision. Recently, they have been used in many natural language processing applications but not for slot tagging. In this paper, we explore metric-based learning methods in the slot tagging task and propose a novel metric-based learning architecture - Attentive Relational Network. Our proposed method extends relation networks, making them more suitable for natural language processing applications in general, by leveraging pretrained contextual embeddings such as ELMO and BERT and by using attention mechanism. The results on SNIPS data show that our proposed method outperforms other state of the art metric-based learning methods.
Anthology ID:
2021.eacl-main.134
Volume:
Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume
Month:
April
Year:
2021
Address:
Online
Editors:
Paola Merlo, Jorg Tiedemann, Reut Tsarfaty
Venue:
EACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1566–1572
Language:
URL:
https://aclanthology.org/2021.eacl-main.134
DOI:
10.18653/v1/2021.eacl-main.134
Bibkey:
Cite (ACL):
Cennet Oguz and Ngoc Thang Vu. 2021. Few-shot Learning for Slot Tagging with Attentive Relational Network. In Proceedings of the 16th Conference of the European Chapter of the Association for Computational Linguistics: Main Volume, pages 1566–1572, Online. Association for Computational Linguistics.
Cite (Informal):
Few-shot Learning for Slot Tagging with Attentive Relational Network (Oguz & Vu, EACL 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.eacl-main.134.pdf