Hawkes based Representation Learning for Reasoning over Scale-free Community-structured Temporal Knowledge Graphs

Yuwei Du, Xinyue Liu, Wenxin Liang, Linlin Zong, Xianchao Zhang


Abstract
Temporal knowledge graph (TKG) reasoning has become a hot topic due to its great value in many practical tasks. The key to TKG reasoning is modeling the structural information and evolutional patterns of the TKGs. While great efforts have been devoted to TKG reasoning, the structural and evolutional characteristics of real-world networks have not been considered. In the aspect of structure, real-world networks usually exhibit clear community structure and scale-free (long-tailed distribution) properties. In the aspect of evolution, the impact of an event decays with the time elapsing. In this paper, we propose a novel TKG reasoning model called Hawkes process-based Evolutional Representation Learning Network (HERLN), which learns structural information and evolutional patterns of a TKG simultaneously, considering the characteristics of real-world networks: community structure, scale-free and temporal decaying. First, we find communities in the input TKG to make the encoding get more similar intra-community embeddings. Second, we design a Hawkes process-based relational graph convolutional network to cope with the event impact-decaying phenomenon. Third, we design a conditional decoding method to alleviate biases towards frequent entities caused by long-tailed distribution. Experimental results show that HERLN achieves significant improvements over the state-of-the-art models.
Anthology ID:
2025.coling-main.198
Volume:
Proceedings of the 31st International Conference on Computational Linguistics
Month:
January
Year:
2025
Address:
Abu Dhabi, UAE
Editors:
Owen Rambow, Leo Wanner, Marianna Apidianaki, Hend Al-Khalifa, Barbara Di Eugenio, Steven Schockaert
Venue:
COLING
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
2935–2946
Language:
URL:
https://aclanthology.org/2025.coling-main.198/
DOI:
Bibkey:
Cite (ACL):
Yuwei Du, Xinyue Liu, Wenxin Liang, Linlin Zong, and Xianchao Zhang. 2025. Hawkes based Representation Learning for Reasoning over Scale-free Community-structured Temporal Knowledge Graphs. In Proceedings of the 31st International Conference on Computational Linguistics, pages 2935–2946, Abu Dhabi, UAE. Association for Computational Linguistics.
Cite (Informal):
Hawkes based Representation Learning for Reasoning over Scale-free Community-structured Temporal Knowledge Graphs (Du et al., COLING 2025)
Copy Citation:
PDF:
https://aclanthology.org/2025.coling-main.198.pdf