## Knowledge Graph Representation Learning using Ordinary Differential Equations

Mojtaba Nayyeri, Chengjin Xu, Franca Hoffmann, Mirza Mohtashim Alam, Jens Lehmann, Sahar Vahdati

##### Abstract

Knowledge Graph Embeddings (KGEs) have shown promising performance on link prediction tasks by mapping the entities and relations from a knowledge graph into a geometric space. The capability of KGEs in preserving graph characteristics including structural aspects and semantics, highly depends on the design of their score function, as well as the inherited abilities from the underlying geometry. Many KGEs use the Euclidean geometry which renders them incapable of preserving complex structures and consequently causes wrong inferences by the models. To address this problem, we propose a neuro differential KGE that embeds nodes of a KG on the trajectories of Ordinary Differential Equations (ODEs). To this end, we represent each relation (edge) in a KG as a vector field on several manifolds. We specifically parameterize ODEs by a neural network to represent complex manifolds and complex vector fields on the manifolds. Therefore, the underlying embedding space is capable to assume the shape of various geometric forms to encode heterogeneous subgraphs. Experiments on synthetic and benchmark datasets using state-of-the-art KGE models justify the ODE trajectories as a means to enable structure preservation and consequently avoiding wrong inferences.- Anthology ID:
- 2021.emnlp-main.750
- Volume:
- Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing
- Month:
- November
- Year:
- 2021
- Address:
- Online and Punta Cana, Dominican Republic
- Editors:
- Marie-Francine Moens, Xuanjing Huang, Lucia Specia, Scott Wen-tau Yih
- Venue:
- EMNLP
- SIG:
- Publisher:
- Association for Computational Linguistics
- Note:
- Pages:
- 9529–9548
- Language:
- URL:
- https://aclanthology.org/2021.emnlp-main.750
- DOI:
- 10.18653/v1/2021.emnlp-main.750
- Cite (ACL):
- Mojtaba Nayyeri, Chengjin Xu, Franca Hoffmann, Mirza Mohtashim Alam, Jens Lehmann, and Sahar Vahdati. 2021. Knowledge Graph Representation Learning using Ordinary Differential Equations. In
*Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing*, pages 9529–9548, Online and Punta Cana, Dominican Republic. Association for Computational Linguistics. - Cite (Informal):
- Knowledge Graph Representation Learning using Ordinary Differential Equations (Nayyeri et al., EMNLP 2021)
- PDF:
- https://aclanthology.org/2021.emnlp-main.750.pdf
- Data
- FB15k-237