AutoETER: Automated Entity Type Representation for Knowledge Graph Embedding

Guanglin Niu, Bo Li, Yongfei Zhang, Shiliang Pu, Jingyang Li


Abstract
Recent advances in Knowledge Graph Embedding (KGE) allow for representing entities and relations in continuous vector spaces. Some traditional KGE models leveraging additional type information can improve the representation of entities which however totally rely on the explicit types or neglect the diverse type representations specific to various relations. Besides, none of the existing methods is capable of inferring all the relation patterns of symmetry, inversion and composition as well as the complex properties of 1-N, N-1 and N-N relations, simultaneously. To explore the type information for any KG, we develop a novel KGE framework with Automated Entity TypE Representation (AutoETER), which learns the latent type embedding of each entity by regarding each relation as a translation operation between the types of two entities with a relation-aware projection mechanism. Particularly, our designed automated type representation learning mechanism is a pluggable module which can be easily incorporated with any KGE model. Besides, our approach could model and infer all the relation patterns and complex relations. Experiments on four datasets demonstrate the superior performance of our model compared to state-of-the-art baselines on link prediction tasks, and the visualization of type clustering provides clearly the explanation of type embeddings and verifies the effectiveness of our model.
Anthology ID:
2020.findings-emnlp.105
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2020
Month:
November
Year:
2020
Address:
Online
Editors:
Trevor Cohn, Yulan He, Yang Liu
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1172–1181
Language:
URL:
https://aclanthology.org/2020.findings-emnlp.105
DOI:
10.18653/v1/2020.findings-emnlp.105
Bibkey:
Cite (ACL):
Guanglin Niu, Bo Li, Yongfei Zhang, Shiliang Pu, and Jingyang Li. 2020. AutoETER: Automated Entity Type Representation for Knowledge Graph Embedding. In Findings of the Association for Computational Linguistics: EMNLP 2020, pages 1172–1181, Online. Association for Computational Linguistics.
Cite (Informal):
AutoETER: Automated Entity Type Representation for Knowledge Graph Embedding (Niu et al., Findings 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.findings-emnlp.105.pdf
Video:
 https://slideslive.com/38940167
Data
FB15k-237YAGO