Enhancing Multiple-Choice Question Answering with Causal Knowledge

Dhairya Dalal, Mihael Arcan, Paul Buitelaar


Abstract
The task of causal question answering aims to reason about causes and effects over a provided real or hypothetical premise. Recent approaches have converged on using transformer-based language models to solve question answering tasks. However, pretrained language models often struggle when external knowledge is not present in the premise or when additional context is required to answer the question. To the best of our knowledge, no prior work has explored the efficacy of augmenting pretrained language models with external causal knowledge for multiple-choice causal question answering. In this paper, we present novel strategies for the representation of causal knowledge. Our empirical results demonstrate the efficacy of augmenting pretrained models with external causal knowledge. We show improved performance on the COPA (Choice of Plausible Alternatives) and WIQA (What If Reasoning Over Procedural Text) benchmark tasks. On the WIQA benchmark, our approach is competitive with the state-of-the-art and exceeds it within the evaluation subcategories of In-Paragraph and Out-of-Paragraph perturbations.
Anthology ID:
2021.deelio-1.8
Volume:
Proceedings of Deep Learning Inside Out (DeeLIO): The 2nd Workshop on Knowledge Extraction and Integration for Deep Learning Architectures
Month:
June
Year:
2021
Address:
Online
Venues:
DeeLIO | NAACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
70–80
Language:
URL:
https://aclanthology.org/2021.deelio-1.8
DOI:
10.18653/v1/2021.deelio-1.8
Bibkey:
Cite (ACL):
Dhairya Dalal, Mihael Arcan, and Paul Buitelaar. 2021. Enhancing Multiple-Choice Question Answering with Causal Knowledge. In Proceedings of Deep Learning Inside Out (DeeLIO): The 2nd Workshop on Knowledge Extraction and Integration for Deep Learning Architectures, pages 70–80, Online. Association for Computational Linguistics.
Cite (Informal):
Enhancing Multiple-Choice Question Answering with Causal Knowledge (Dalal et al., DeeLIO 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.deelio-1.8.pdf
Data
ConceptNetWIQA