TranS: Transition-based Knowledge Graph Embedding with Synthetic Relation Representation

Xuanyu Zhang, Qing Yang, Dongliang Xu


Abstract
Knowledge graph embedding (KGE) aims to learn continuous vector representations of relations and entities in knowledge graph (KG). Recently, transition-based KGE methods have become popular and achieved promising performance. However, scoring patterns like TransE are not suitable for complex scenarios where the same entity pair has different relations. Although some models attempt to employ entity-relation interaction or projection to improve entity representation for one-to-many/many-to-one/many-to-many complex relations, they still continue the traditional scoring pattern, where only a single relation vector in the relation part is used to translate the head entity to the tail entity or their variants. And recent research shows that entity representation only needs to consider entities and their interactions to achieve better performance. Thus, in this paper, we propose a novel transition-based method, TranS, for KGE. The single relation vector of the relation part in the traditional scoring pattern is replaced by the synthetic relation representation with entity-relation interactions to solve these issues. And the entity part still retains its independence through entity-entity interactions. Experiments on a large KG dataset, ogbl-wikikg2, show that our model achieves state-of-the-art results.
Anthology ID:
2022.findings-emnlp.86
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2022
Month:
December
Year:
2022
Address:
Abu Dhabi, United Arab Emirates
Editors:
Yoav Goldberg, Zornitsa Kozareva, Yue Zhang
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1202–1208
Language:
URL:
https://aclanthology.org/2022.findings-emnlp.86
DOI:
10.18653/v1/2022.findings-emnlp.86
Bibkey:
Cite (ACL):
Xuanyu Zhang, Qing Yang, and Dongliang Xu. 2022. TranS: Transition-based Knowledge Graph Embedding with Synthetic Relation Representation. In Findings of the Association for Computational Linguistics: EMNLP 2022, pages 1202–1208, Abu Dhabi, United Arab Emirates. Association for Computational Linguistics.
Cite (Informal):
TranS: Transition-based Knowledge Graph Embedding with Synthetic Relation Representation (Zhang et al., Findings 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.findings-emnlp.86.pdf