Multi-Hop Relation Aware Representations for Inductive Knowledge Graphs

Bala Aniruddha, Sharma Ankit, Sharma Shlok, Bhaskar Pinaki


Abstract
Recent knowledge graph (KG) embedding methods explore parameter-efficient representations for large-scale KGs. These techniques learn entity representation using a fixed size vocabulary. Such a vocabulary consists of all the relations and a small subset of the full entity set, referred to as anchors. An entity is hence expressed as a function of reachable anchors and immediate relations. The performance of these methods is, therefore, largely dependent on the entity tokenization strategy. Especially in inductive settings, the representation capacity of these embeddings is limited due to the absence of anchor entities, as unseen entities have no connection with training graph entities. In this work, we propose a novel entity tokenization strategy that tokenizes an entity into a set of anchors based on relation similarity and relational paths. Our model MH-RARe overcomes the challenge of unseen entities not being directly connected to the anchors by selecting informative anchors from the training graph using relation similarity. Experiment results show that our model outperforms the baselines on multiple datasets for inductive knowledge graph completion task, attaining upto 5% improvement, while maintaining parameter efficiency.
Anthology ID:
2023.icon-1.3
Volume:
Proceedings of the 20th International Conference on Natural Language Processing (ICON)
Month:
December
Year:
2023
Address:
Goa University, Goa, India
Editors:
D. Pawar Jyoti, Lalitha Devi Sobha
Venue:
ICON
SIG:
SIGLEX
Publisher:
NLP Association of India (NLPAI)
Note:
Pages:
27–35
Language:
URL:
https://aclanthology.org/2023.icon-1.3
DOI:
Bibkey:
Cite (ACL):
Bala Aniruddha, Sharma Ankit, Sharma Shlok, and Bhaskar Pinaki. 2023. Multi-Hop Relation Aware Representations for Inductive Knowledge Graphs. In Proceedings of the 20th International Conference on Natural Language Processing (ICON), pages 27–35, Goa University, Goa, India. NLP Association of India (NLPAI).
Cite (Informal):
Multi-Hop Relation Aware Representations for Inductive Knowledge Graphs (Aniruddha et al., ICON 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.icon-1.3.pdf