GreenKGC: A Lightweight Knowledge Graph Completion Method

Yun Cheng Wang, Xiou Ge, Bin Wang, C.-C. Jay Kuo


Abstract
Knowledge graph completion (KGC) aims to discover missing relationships between entities in knowledge graphs (KGs). Most prior KGC work focuses on learning embeddings for entities and relations through a simple score function. Yet, a higher-dimensional embedding space is usually required for a better reasoning capability, which leads to larger model size and hinders applicability to real-world problems (e.g., large-scale KGs or mobile/edge computing). A lightweight modularized KGC solution, called GreenKGC, is proposed in this work to address this issue. GreenKGC consists of three modules: representation learning, feature pruning, and decision learning, to extract discriminant KG features and make accurate predictions on missing relationships using classifiers and negative sampling. Experimental results demonstrate that, in low dimensions, GreenKGC can outperform SOTA methods in most datasets. In addition, low-dimensional GreenKGC can achieve competitive or even better performance against high-dimensional models with a much smaller model size.
Anthology ID:
2023.acl-long.591
Volume:
Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Anna Rogers, Jordan Boyd-Graber, Naoaki Okazaki
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
10596–10613
Language:
URL:
https://aclanthology.org/2023.acl-long.591
DOI:
10.18653/v1/2023.acl-long.591
Bibkey:
Cite (ACL):
Yun Cheng Wang, Xiou Ge, Bin Wang, and C.-C. Jay Kuo. 2023. GreenKGC: A Lightweight Knowledge Graph Completion Method. In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 10596–10613, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
GreenKGC: A Lightweight Knowledge Graph Completion Method (Wang et al., ACL 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.acl-long.591.pdf
Video:
 https://aclanthology.org/2023.acl-long.591.mp4