CURIE: An Iterative Querying Approach for Reasoning About Situations

Dheeraj Rajagopal, Aman Madaan, Niket Tandon, Yiming Yang, Shrimai Prabhumoye, Abhilasha Ravichander, Peter Clark, Eduard H Hovy


Abstract
Predicting the effects of unexpected situations is an important reasoning task, e.g., would cloudy skies help or hinder plant growth? Given a context, the goal of such situational reasoning is to elicit the consequences of a new situation (st) that arises in that context. We propose CURIE, a method to iteratively build a graph of relevant consequences explicitly in a structured situational graph (st graph) using natural language queries over a finetuned language model. Across multiple domains, CURIE generates st graphs that humans find relevant and meaningful in eliciting the consequences of a new situation (75% of the graphs were judged correct by humans). We present a case study of a situation reasoning end task (WIQA-QA), where simply augmenting their input with st graphs improves accuracy by 3 points. We show that these improvements mainly come from a hard subset of the data, that requires background knowledge and multi-hop reasoning.
Anthology ID:
2022.csrr-1.7
Volume:
Proceedings of the First Workshop on Commonsense Representation and Reasoning (CSRR 2022)
Month:
May
Year:
2022
Address:
Dublin, Ireland
Editors:
Antoine Bosselut, Xiang Li, Bill Yuchen Lin, Vered Shwartz, Bodhisattwa Prasad Majumder, Yash Kumar Lal, Rachel Rudinger, Xiang Ren, Niket Tandon, Vilém Zouhar
Venue:
CSRR
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
49–63
Language:
URL:
https://aclanthology.org/2022.csrr-1.7
DOI:
10.18653/v1/2022.csrr-1.7
Bibkey:
Cite (ACL):
Dheeraj Rajagopal, Aman Madaan, Niket Tandon, Yiming Yang, Shrimai Prabhumoye, Abhilasha Ravichander, Peter Clark, and Eduard H Hovy. 2022. CURIE: An Iterative Querying Approach for Reasoning About Situations. In Proceedings of the First Workshop on Commonsense Representation and Reasoning (CSRR 2022), pages 49–63, Dublin, Ireland. Association for Computational Linguistics.
Cite (Informal):
CURIE: An Iterative Querying Approach for Reasoning About Situations (Rajagopal et al., CSRR 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.csrr-1.7.pdf
Video:
 https://aclanthology.org/2022.csrr-1.7.mp4
Data
QuaRTzQuaRelWIQA