Advancing Fact-Checking for Large Language Models via Argumentative Reasoning

Zirong Chen, Xiangwei Lv, Zhaoqun Li, Wenwei Ke, Jinxiong Chang, Linjian Mo, Beishui Liao


Abstract
Large language models (LLMs) are increasingly used in high-stakes domains, yet their unfaithful or non-factual outputs create serious risks and hinder trustworthy deployment. Rigorous fact-checking is therefore essential to mitigate these risks. Most existing factuality verification methods improve evidence acquisition, but fail to capture complex logical relations between claims and multi-source evidence, especially when different evidence sources are inconsistent or incomplete. Moreover, current benchmarks rarely capture such realistic conflict scenarios. To address this, we introduce MAVEN, a real-world benchmark for verifying complex claims against heterogeneous and conflicting web evidence with fine-grained explanations. We further propose ArgCheck, an argumentation-based fact-checking framework. It models claims and retrieved evidence as arguments linked by attack relations, resolving conflicts through formal argumentation semantics. To avoid incomplete evidence, ArgCheck incorporates adversarial web retrieval to gather balanced multi-source evidence and grounds its verdicts and explanations in accepted arguments. Experiments on MAVEN and the public fact-checking benchmark AVeriTeC show that ArgCheck improves Macro-F1 over the strongest baseline by 5.39 and 11.10 points, respectively, while generating more faithful and evidence-grounded explanations. Our code and dataset are available online https://github.com/ZyraChen/ArgCheck.
Anthology ID:
2026.emnlp-main.1207
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
27611–27630
Language:
URL:
https://aclanthology.org/2026.emnlp-main.1207/
DOI:
Bibkey:
Cite (ACL):
Zirong Chen, Xiangwei Lv, Zhaoqun Li, Wenwei Ke, Jinxiong Chang, Linjian Mo, and Beishui Liao. 2026. Advancing Fact-Checking for Large Language Models via Argumentative Reasoning. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 27611–27630, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Advancing Fact-Checking for Large Language Models via Argumentative Reasoning (Chen et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.1207.pdf