Commonsense Evidence Generation and Injection in Reading Comprehension

Ye Liu, Tao Yang, Zeyu You, Wei Fan, Philip S. Yu


Abstract
Human tackle reading comprehension not only based on the given context itself but often rely on the commonsense beyond. To empower the machine with commonsense reasoning, in this paper, we propose a Commonsense Evidence Generation and Injection framework in reading comprehension, named CEGI. The framework injects two kinds of auxiliary commonsense evidence into comprehensive reading to equip the machine with the ability of rational thinking. Specifically, we build two evidence generators: one aims to generate textual evidence via a language model; the other aims to extract factual evidence (automatically aligned text-triples) from a commonsense knowledge graph after graph completion. Those evidences incorporate contextual commonsense and serve as the additional inputs to the reasoning model. Thereafter, we propose a deep contextual encoder to extract semantic relationships among the paragraph, question, option, and evidence. Finally, we employ a capsule network to extract different linguistic units (word and phrase) from the relations, and dynamically predict the optimal option based on the extracted units. Experiments on the CosmosQA dataset demonstrate that the proposed CEGI model outperforms the current state-of-the-art approaches and achieves the highest accuracy (83.6%) on the leaderboard.
Anthology ID:
2020.sigdial-1.9
Volume:
Proceedings of the 21th Annual Meeting of the Special Interest Group on Discourse and Dialogue
Month:
July
Year:
2020
Address:
1st virtual meeting
Editors:
Olivier Pietquin, Smaranda Muresan, Vivian Chen, Casey Kennington, David Vandyke, Nina Dethlefs, Koji Inoue, Erik Ekstedt, Stefan Ultes
Venue:
SIGDIAL
SIG:
SIGDIAL
Publisher:
Association for Computational Linguistics
Note:
Pages:
61–73
Language:
URL:
https://aclanthology.org/2020.sigdial-1.9
DOI:
10.18653/v1/2020.sigdial-1.9
Bibkey:
Cite (ACL):
Ye Liu, Tao Yang, Zeyu You, Wei Fan, and Philip S. Yu. 2020. Commonsense Evidence Generation and Injection in Reading Comprehension. In Proceedings of the 21th Annual Meeting of the Special Interest Group on Discourse and Dialogue, pages 61–73, 1st virtual meeting. Association for Computational Linguistics.
Cite (Informal):
Commonsense Evidence Generation and Injection in Reading Comprehension (Liu et al., SIGDIAL 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.sigdial-1.9.pdf
Data
CoS-ECommonsenseQAConceptNet