Find Parent then Label Children: A Two-stage Taxonomy Completion Method with Pre-trained Language Model

Fei Xia, Yixuan Weng, Shizhu He, Kang Liu, Jun Zhao


Abstract
Taxonomies, which organize domain concepts into hierarchical structures, are crucial for building knowledge systems and downstream applications. As domain knowledge evolves, taxonomies need to be continuously updated to include new concepts. Previous approaches have mainly focused on adding concepts to the leaf nodes of the existing hierarchical tree, which does not fully utilize the taxonomy’s knowledge and is unable to update the original taxonomy structure (usually involving non-leaf nodes). In this paper, we propose a two-stage method called ATTEMPT for taxonomy completion. Our method inserts new concepts into the correct position by finding a parent node and labeling child nodes. Specifically, by combining local nodes with prompts to generate natural sentences, we take advantage of pre-trained language models for hypernym/hyponymy recognition. Experimental results on two public datasets (including six domains) show that ATTEMPT performs best on both taxonomy completion and extension tasks, surpassing existing methods.
Anthology ID:
2023.eacl-main.73
Volume:
Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics
Month:
May
Year:
2023
Address:
Dubrovnik, Croatia
Editors:
Andreas Vlachos, Isabelle Augenstein
Venue:
EACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1032–1042
Language:
URL:
https://aclanthology.org/2023.eacl-main.73
DOI:
10.18653/v1/2023.eacl-main.73
Bibkey:
Cite (ACL):
Fei Xia, Yixuan Weng, Shizhu He, Kang Liu, and Jun Zhao. 2023. Find Parent then Label Children: A Two-stage Taxonomy Completion Method with Pre-trained Language Model. In Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics, pages 1032–1042, Dubrovnik, Croatia. Association for Computational Linguistics.
Cite (Informal):
Find Parent then Label Children: A Two-stage Taxonomy Completion Method with Pre-trained Language Model (Xia et al., EACL 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.eacl-main.73.pdf
Video:
 https://aclanthology.org/2023.eacl-main.73.mp4