Towards Understanding the Geometry of Knowledge Graph Embeddings

Chandrahas, Aditya Sharma, Partha Talukdar


Abstract
Knowledge Graph (KG) embedding has emerged as a very active area of research over the last few years, resulting in the development of several embedding methods. These KG embedding methods represent KG entities and relations as vectors in a high-dimensional space. Despite this popularity and effectiveness of KG embeddings in various tasks (e.g., link prediction), geometric understanding of such embeddings (i.e., arrangement of entity and relation vectors in vector space) is unexplored – we fill this gap in the paper. We initiate a study to analyze the geometry of KG embeddings and correlate it with task performance and other hyperparameters. To the best of our knowledge, this is the first study of its kind. Through extensive experiments on real-world datasets, we discover several insights. For example, we find that there are sharp differences between the geometry of embeddings learnt by different classes of KG embeddings methods. We hope that this initial study will inspire other follow-up research on this important but unexplored problem.
Anthology ID:
P18-1012
Volume:
Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
July
Year:
2018
Address:
Melbourne, Australia
Editors:
Iryna Gurevych, Yusuke Miyao
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
122–131
Language:
URL:
https://aclanthology.org/P18-1012
DOI:
10.18653/v1/P18-1012
Bibkey:
Cite (ACL):
Chandrahas, Aditya Sharma, and Partha Talukdar. 2018. Towards Understanding the Geometry of Knowledge Graph Embeddings. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 122–131, Melbourne, Australia. Association for Computational Linguistics.
Cite (Informal):
Towards Understanding the Geometry of Knowledge Graph Embeddings (Chandrahas et al., ACL 2018)
Copy Citation:
PDF:
https://aclanthology.org/P18-1012.pdf
Note:
 P18-1012.Notes.pdf
Software:
 P18-1012.Software.zip
Presentation:
 P18-1012.Presentation.pdf
Video:
 https://aclanthology.org/P18-1012.mp4
Code
 malllabiisc/kg-geometry