Improving Knowledge Graph Embedding Using Simple Constraints

Boyang Ding, Quan Wang, Bin Wang, Li Guo


Abstract
Embedding knowledge graphs (KGs) into continuous vector spaces is a focus of current research. Early works performed this task via simple models developed over KG triples. Recent attempts focused on either designing more complicated triple scoring models, or incorporating extra information beyond triples. This paper, by contrast, investigates the potential of using very simple constraints to improve KG embedding. We examine non-negativity constraints on entity representations and approximate entailment constraints on relation representations. The former help to learn compact and interpretable representations for entities. The latter further encode regularities of logical entailment between relations into their distributed representations. These constraints impose prior beliefs upon the structure of the embedding space, without negative impacts on efficiency or scalability. Evaluation on WordNet, Freebase, and DBpedia shows that our approach is simple yet surprisingly effective, significantly and consistently outperforming competitive baselines. The constraints imposed indeed improve model interpretability, leading to a substantially increased structuring of the embedding space. Code and data are available at https://github.com/iieir-km/ComplEx-NNE_AER.
Anthology ID:
P18-1011
Volume:
Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
July
Year:
2018
Address:
Melbourne, Australia
Editors:
Iryna Gurevych, Yusuke Miyao
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
110–121
Language:
URL:
https://aclanthology.org/P18-1011
DOI:
10.18653/v1/P18-1011
Bibkey:
Cite (ACL):
Boyang Ding, Quan Wang, Bin Wang, and Li Guo. 2018. Improving Knowledge Graph Embedding Using Simple Constraints. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 110–121, Melbourne, Australia. Association for Computational Linguistics.
Cite (Informal):
Improving Knowledge Graph Embedding Using Simple Constraints (Ding et al., ACL 2018)
Copy Citation:
PDF:
https://aclanthology.org/P18-1011.pdf
Note:
 P18-1011.Notes.pdf
Software:
 P18-1011.Software.zip
Presentation:
 P18-1011.Presentation.pdf
Video:
 https://aclanthology.org/P18-1011.mp4
Code
 iieir-km/ComplEx-NNE_AER