Multi-view Contrastive Learning for Entity Typing over Knowledge Graphs

Zhiwei Hu, Victor Basulto, Zhiliang Xiang, Ru Li, Jeff Pan


Abstract
Knowledge graph entity typing (KGET) aims at inferring plausible types of entities in knowledge graphs. Existing approaches to KGET focus on how to better encode the knowledge provided by the neighbors and types of an entity into its representation. However, they ignore the semantic knowledge provided by the way in which types can be clustered together. In this paper, we propose a novel method called Multi-view Contrastive Learning for knowledge graph Entity Typing MCLET, which effectively encodes the coarse-grained knowledge provided by clusters into entity and type embeddings. MCLET is composed of three modules: i) Multi-view Generation and Encoder module, which encodes structured information from entity-type, entity-cluster and cluster-type views; ii) Cross-view Contrastive Learning module, which encourages different views to collaboratively improve view-specific representations of entities and types; iii) Entity Typing Prediction module, which integrates multi-head attention and a Mixture-of-Experts strategy to infer missing entity types. Extensive experiments show the strong performance of MCLET compared to the state-of-the-art
Anthology ID:
2023.emnlp-main.800
Volume:
Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing
Month:
December
Year:
2023
Address:
Singapore
Editors:
Houda Bouamor, Juan Pino, Kalika Bali
Venue:
EMNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
12950–12963
Language:
URL:
https://aclanthology.org/2023.emnlp-main.800
DOI:
10.18653/v1/2023.emnlp-main.800
Bibkey:
Cite (ACL):
Zhiwei Hu, Victor Basulto, Zhiliang Xiang, Ru Li, and Jeff Pan. 2023. Multi-view Contrastive Learning for Entity Typing over Knowledge Graphs. In Proceedings of the 2023 Conference on Empirical Methods in Natural Language Processing, pages 12950–12963, Singapore. Association for Computational Linguistics.
Cite (Informal):
Multi-view Contrastive Learning for Entity Typing over Knowledge Graphs (Hu et al., EMNLP 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.emnlp-main.800.pdf
Video:
 https://aclanthology.org/2023.emnlp-main.800.mp4