Generating and Evaluating Plausible Explanations for Knowledge Graph Completion

Antonio Di Mauro, Zhao Xu, Wiem Ben Rim, Timo Sztyler, Carolin Lawrence


Abstract
Explanations for AI should aid human users, yet this ultimate goal remains under-explored. This paper aims to bridge this gap by investigating the specific explanatory needs of human users in the context of Knowledge Graph Completion (KGC) systems. In contrast to the prevailing approaches that primarily focus on mathematical theories, we recognize the potential limitations of explanations that may end up being overly complex or nonsensical for users. Through in-depth user interviews, we gain valuable insights into the types of KGC explanations users seek. Building upon these insights, we introduce GradPath, a novel path-based explanation method designed to meet human-centric explainability constraints and enhance plausibility. Additionally, GradPath harnesses the gradients of the trained KGC model to maintain a certain level of faithfulness. We verify the effectiveness of GradPath through well-designed human-centric evaluations. The results confirm that our method provides explanations that users consider more plausible than previous ones.
Anthology ID:
2024.acl-long.654
Volume:
Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
August
Year:
2024
Address:
Bangkok, Thailand
Editors:
Lun-Wei Ku, Andre Martins, Vivek Srikumar
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
12106–12118
Language:
URL:
https://aclanthology.org/2024.acl-long.654
DOI:
Bibkey:
Cite (ACL):
Antonio Di Mauro, Zhao Xu, Wiem Ben Rim, Timo Sztyler, and Carolin Lawrence. 2024. Generating and Evaluating Plausible Explanations for Knowledge Graph Completion. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 12106–12118, Bangkok, Thailand. Association for Computational Linguistics.
Cite (Informal):
Generating and Evaluating Plausible Explanations for Knowledge Graph Completion (Di Mauro et al., ACL 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.acl-long.654.pdf