Improving Knowledge Graph Completion with Generative Hard Negative Mining

Zile Qiao, Wei Ye, Dingyao Yu, Tong Mo, Weiping Li, Shikun Zhang


Abstract
Contrastive learning has recently shown great potential to improve text-based knowledge graph completion (KGC). In this paper, we propose to learn a more semantically structured entity representation space in text-based KGC via hard negatives mining. Specifically, we novelly leverage a sequence-to-sequence architecture to generate high-quality hard negatives. These negatives are sampled from the same decoding distributions as the anchor (or correct entity), inherently being semantically close to the anchor and thus enjoying good hardness. A self-information-enhanced contrasting strategy is further incorporated into the Seq2Seq generator to systematically diversify the produced negatives. Extensive experiments on three KGC benchmarks demonstrate the sound hardness and diversity of our generated negatives and the resulting performance superiority on KGC.
Anthology ID:
2023.findings-acl.362
Volume:
Findings of the Association for Computational Linguistics: ACL 2023
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Anna Rogers, Jordan Boyd-Graber, Naoaki Okazaki
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
5866–5878
Language:
URL:
https://aclanthology.org/2023.findings-acl.362
DOI:
10.18653/v1/2023.findings-acl.362
Bibkey:
Cite (ACL):
Zile Qiao, Wei Ye, Dingyao Yu, Tong Mo, Weiping Li, and Shikun Zhang. 2023. Improving Knowledge Graph Completion with Generative Hard Negative Mining. In Findings of the Association for Computational Linguistics: ACL 2023, pages 5866–5878, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
Improving Knowledge Graph Completion with Generative Hard Negative Mining (Qiao et al., Findings 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.findings-acl.362.pdf