Text Augmented Open Knowledge Graph Completion via Pre-Trained Language Models

Pengcheng Jiang, Shivam Agarwal, Bowen Jin, Xuan Wang, Jimeng Sun, Jiawei Han


Abstract
The mission of open knowledge graph (KG) completion is to draw new findings from known facts. Existing works that augment KG completion require either (1) factual triples to enlarge the graph reasoning space or (2) manually designed prompts to extract knowledge from a pre-trained language model (PLM), exhibiting limited performance and requiring expensive efforts from experts. To this end, we propose TagReal that automatically generates quality query prompts and retrieves support information from large text corpora to probe knowledge from PLM for KG completion. The results show that TagReal achieves state-of-the-art performance on two benchmark datasets. We find that TagReal has superb performance even with limited training data, outperforming existing embedding-based, graph-based, and PLM-based methods.
Anthology ID:
2023.findings-acl.709
Volume:
Findings of the Association for Computational Linguistics: ACL 2023
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Anna Rogers, Jordan Boyd-Graber, Naoaki Okazaki
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
11161–11180
Language:
URL:
https://aclanthology.org/2023.findings-acl.709
DOI:
10.18653/v1/2023.findings-acl.709
Bibkey:
Cite (ACL):
Pengcheng Jiang, Shivam Agarwal, Bowen Jin, Xuan Wang, Jimeng Sun, and Jiawei Han. 2023. Text Augmented Open Knowledge Graph Completion via Pre-Trained Language Models. In Findings of the Association for Computational Linguistics: ACL 2023, pages 11161–11180, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
Text Augmented Open Knowledge Graph Completion via Pre-Trained Language Models (Jiang et al., Findings 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.findings-acl.709.pdf
Video:
 https://aclanthology.org/2023.findings-acl.709.mp4