Sequential and Repetitive Pattern Learning for Temporal Knowledge Graph Reasoning

Xuefei Li, Huiwei Zhou, Weihong Yao, Wenchu Li, Yingyu Lin, Lei Du


Abstract
Temporal Knowledge Graph (TKG) reasoning has received a growing interest recently, especially in forecasting the future facts based on the historical KG sequences. Existing studies typically utilize a recurrent neural network to learn the evolutional representations of entities for temporal reasoning. However, these methods are hard to capture the complex temporal evolutional patterns such as sequential and repetitive patterns accurately. To tackle this challenge, we propose a novel Sequential and Repetitive Pattern Learning (SRPL) method, which comprehensively captures both the sequential and repetitive patterns. Specifically, a Dependency-aware Sequential Pattern Learning (DSPL) component expresses the temporal dependencies of each historical timestamp as embeddings for accurately capturing the sequential patterns across temporally adjacent facts. A Time-interval guided Repetitive Pattern Learning (TRPL) component models the irregular time intervals between historical repetitive facts for capturing the repetitive patterns. Extensive experiments on four representative benchmarks demonstrate that our proposed method outperforms state-of-the-art methods in all metrics by an obvious margin, especially on GDELT dataset, where performance improvement of MRR reaches up to 18.84%.
Anthology ID:
2024.lrec-main.1284
Volume:
Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024)
Month:
May
Year:
2024
Address:
Torino, Italia
Editors:
Nicoletta Calzolari, Min-Yen Kan, Veronique Hoste, Alessandro Lenci, Sakriani Sakti, Nianwen Xue
Venues:
LREC | COLING
SIG:
Publisher:
ELRA and ICCL
Note:
Pages:
14744–14754
Language:
URL:
https://aclanthology.org/2024.lrec-main.1284
DOI:
Bibkey:
Cite (ACL):
Xuefei Li, Huiwei Zhou, Weihong Yao, Wenchu Li, Yingyu Lin, and Lei Du. 2024. Sequential and Repetitive Pattern Learning for Temporal Knowledge Graph Reasoning. In Proceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), pages 14744–14754, Torino, Italia. ELRA and ICCL.
Cite (Informal):
Sequential and Repetitive Pattern Learning for Temporal Knowledge Graph Reasoning (Li et al., LREC-COLING 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.lrec-main.1284.pdf