Chain of Condition: Construct, Verify and Solve Conditions for Conditional Question Answering

Jiuheng Lin, Yuxuan Lai, Yansong Feng


Abstract
Conditional question answering (CQA) is an important task that aims to find probable answers and identify missing conditions. Existing approaches struggle with CQA due to two challenges: (1) precisely identifying necessary conditions and the logical relationship, and (2) verifying conditions to detect any that are missing. In this paper, we propose a novel prompting approach, Chain of condition, by first identifying all conditions and constructing their logical relationships explicitly according to the document, then verifying whether these conditions are satisfied, finally solving the logical expression to indicate any missing conditions and generating the answer accordingly. Experiments on two CQA benchmark datasets show our chain of condition outperforms existing prompting baselines, establishing a new state of the art. Furthermore, with only a few examples, our method can facilitate GPT-3.5-Turbo or GPT-4 to outperform all existing supervised models.
Anthology ID:
2024.findings-emnlp.968
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2024
Month:
November
Year:
2024
Address:
Miami, Florida, USA
Editors:
Yaser Al-Onaizan, Mohit Bansal, Yun-Nung Chen
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
16596–16611
Language:
URL:
https://aclanthology.org/2024.findings-emnlp.968
DOI:
Bibkey:
Cite (ACL):
Jiuheng Lin, Yuxuan Lai, and Yansong Feng. 2024. Chain of Condition: Construct, Verify and Solve Conditions for Conditional Question Answering. In Findings of the Association for Computational Linguistics: EMNLP 2024, pages 16596–16611, Miami, Florida, USA. Association for Computational Linguistics.
Cite (Informal):
Chain of Condition: Construct, Verify and Solve Conditions for Conditional Question Answering (Lin et al., Findings 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.findings-emnlp.968.pdf