CRAFT: A Unified Counterfactual Reasoning Framework for Tabular Question Answering and Fact Verification

Chenshuo Pan, Yu Zhao, Jie Zhang, Changzai Pan, Jiayi Liang, Yujie Mao, Zhenhe Wu, Shuangyong Song, Yongxiang Li, Zhongjiang He


Abstract
Table reasoning remains challenging for large language models (LLMs), particularly in tasks that require multi-step inference over long and structured tables. Existing approaches predominantly rely on single-direction reasoning, which limits their ability to explore alternative hypotheses across tasks. In this work, we propose CRAFT, a unified Counterfactual Reasoning Framework that reformulates Tabular question answering and fact verification into a general bidirectional verification process. Our method explicitly constructs both declarative statements and their counterfactual variants. Evidence is then extracted from reasoning along both the original and counterfactual paths, and integrated via a weighted mechanism to arrive at the final answer. Experimental results show that our approach consistently surpasses representative baselines on table reasoning datasets such as WikiTQ and TabFact, achieving especially large improvements on complex question answering. Our framework also significantly mitigates performance gaps between different backbone LLMs. This indicates that counterfactual reasoning effectively overcomes the limitations of single-direction inference, guiding LLMs toward more discerning reasoning and establishing a more principled paradigm for structured reasoning tasks.
Anthology ID:
2026.aacl-long.176
Volume:
Proceedings of the 15th International Joint Conference on Natural Language Processing and the 5th Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
November
Year:
2026
Address:
Hengqin, China
Editors:
Yue Zhang, Ruifeng Xu, Ayu Purwarianti, Tong Rong, Jun Suzuki
Venues:
AACL | IJCNLP
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
3934–3959
Language:
URL:
https://aclanthology.org/2026.aacl-long.176/
DOI:
Bibkey:
Cite (ACL):
Chenshuo Pan, Yu Zhao, Jie Zhang, Changzai Pan, Jiayi Liang, Yujie Mao, Zhenhe Wu, Shuangyong Song, Yongxiang Li, and Zhongjiang He. 2026. CRAFT: A Unified Counterfactual Reasoning Framework for Tabular Question Answering and Fact Verification. In Proceedings of the 15th International Joint Conference on Natural Language Processing and the 5th Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics (Volume 1: Long Papers), pages 3934–3959, Hengqin, China. Association for Computational Linguistics.
Cite (Informal):
CRAFT: A Unified Counterfactual Reasoning Framework for Tabular Question Answering and Fact Verification (Pan et al., AACL-IJCNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.aacl-long.176.pdf