End-to-end Case-Based Reasoning for Commonsense Knowledge Base Completion

Zonglin Yang, Xinya Du, Erik Cambria, Claire Cardie


Abstract
Pretrained language models have been shown to store knowledge in their parameters and have achieved reasonable performance in commonsense knowledge base completion (CKBC) tasks. However, CKBC is knowledge-intensive and it is reported that pretrained language models’ performance in knowledge-intensive tasks are limited because of their incapability of accessing and manipulating knowledge. As a result, we hypothesize that providing retrieved passages that contain relevant knowledge as additional input to the CKBC task will improve performance. In particular, we draw insights from Case-Based Reasoning (CBR) – which aims to solve a new problem by reasoning with retrieved relevant cases, and investigate the direct application of it to CKBC. On two benchmark datasets, we demonstrate through automatic and human evaluations that our End-to-end Case-Based Reasoning Framework (ECBRF) generates more valid, informative, and novel knowledge than the state-of-the-art COMET model for CKBC in both the fully supervised and few-shot settings. We provide insights on why previous retrieval-based methods only achieve merely the same performance with COMET. From the perspective of CBR, our framework addresses a fundamental question on whether CBR methodology can be utilized to improve deep learning models.
Anthology ID:
2023.eacl-main.255
Volume:
Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics
Month:
May
Year:
2023
Address:
Dubrovnik, Croatia
Editors:
Andreas Vlachos, Isabelle Augenstein
Venue:
EACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
3509–3522
Language:
URL:
https://aclanthology.org/2023.eacl-main.255
DOI:
10.18653/v1/2023.eacl-main.255
Bibkey:
Cite (ACL):
Zonglin Yang, Xinya Du, Erik Cambria, and Claire Cardie. 2023. End-to-end Case-Based Reasoning for Commonsense Knowledge Base Completion. In Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics, pages 3509–3522, Dubrovnik, Croatia. Association for Computational Linguistics.
Cite (Informal):
End-to-end Case-Based Reasoning for Commonsense Knowledge Base Completion (Yang et al., EACL 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.eacl-main.255.pdf
Video:
 https://aclanthology.org/2023.eacl-main.255.mp4