Complex Reasoning over Logical Queries on Commonsense Knowledge Graphs

Tianqing Fang, Zeming Chen, Yangqiu Song, Antoine Bosselut


Abstract
Event commonsense reasoning requires the ability to reason about the relationship between events, as well as infer implicit contextunderlying that relationship. However, data scarcity makes it challenging for language models to learn to generate commonsense infer-ences for contexts and questions involving interactions between complex events. To address this demand, we present COM2 (COMplexCOMmonsense), a new dataset created by sampling multi-hop logical queries (e.g., the joint effect or cause of both event A and B, or theeffect of the effect of event C) from an existing commonsense knowledge graph (CSKG), and verbalizing them using handcrafted rules andlarge language models into multiple-choice and text generation questions. Our experiments show that language models trained on COM2 exhibit significant improve ments in complex reasoning ability, resulting in enhanced zero-shot performance in both in-domain and out-of-domain tasks for question answering and generative commonsense reasoning, without expensive human annotations
Anthology ID:
2024.acl-long.613
Volume:
Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
August
Year:
2024
Address:
Bangkok, Thailand
Editors:
Lun-Wei Ku, Andre Martins, Vivek Srikumar
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
11365–11384
Language:
URL:
https://aclanthology.org/2024.acl-long.613
DOI:
Bibkey:
Cite (ACL):
Tianqing Fang, Zeming Chen, Yangqiu Song, and Antoine Bosselut. 2024. Complex Reasoning over Logical Queries on Commonsense Knowledge Graphs. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 11365–11384, Bangkok, Thailand. Association for Computational Linguistics.
Cite (Informal):
Complex Reasoning over Logical Queries on Commonsense Knowledge Graphs (Fang et al., ACL 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.acl-long.613.pdf