An Adaptive Logical Rule Embedding Model for Inductive Reasoning over Temporal Knowledge Graphs

Xin Mei, Libin Yang, Xiaoyan Cai, Zuowei Jiang


Abstract
Temporal knowledge graphs (TKGs) extrapolation reasoning predicts future events based on historical information, which has great research significance and broad application value. Existing methods can be divided into embedding-based methods and logical rule-based methods. Embedding-based methods rely on learned entity and relation embeddings to make predictions and thus lack interpretability. Logical rule-based methods bring scalability problems due to being limited by the learned logical rules. We combine the two methods to capture deep causal logic by learning rule embeddings, and propose an interpretable model for temporal knowledge graph reasoning called adaptive logical rule embedding model for inductive reasoning (ALRE-IR). ALRE-IR can adaptively extract and assess reasons contained in historical events, and make predictions based on causal logic. Furthermore, we propose a one-class augmented matching loss for optimization. When evaluated on the ICEWS14, ICEWS0515 and ICEWS18 datasets, the performance of ALRE-IR outperforms other state-of-the-art baselines. The results also demonstrate that ALRE-IR still shows outstanding performance when transferred to related dataset with common relation vocabulary, indicating our proposed model has good zero-shot reasoning ability.
Anthology ID:
2022.emnlp-main.493
Volume:
Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing
Month:
December
Year:
2022
Address:
Abu Dhabi, United Arab Emirates
Editors:
Yoav Goldberg, Zornitsa Kozareva, Yue Zhang
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
7304–7316
Language:
URL:
https://aclanthology.org/2022.emnlp-main.493
DOI:
10.18653/v1/2022.emnlp-main.493
Bibkey:
Cite (ACL):
Xin Mei, Libin Yang, Xiaoyan Cai, and Zuowei Jiang. 2022. An Adaptive Logical Rule Embedding Model for Inductive Reasoning over Temporal Knowledge Graphs. In Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing, pages 7304–7316, Abu Dhabi, United Arab Emirates. Association for Computational Linguistics.
Cite (Informal):
An Adaptive Logical Rule Embedding Model for Inductive Reasoning over Temporal Knowledge Graphs (Mei et al., EMNLP 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.emnlp-main.493.pdf