Trust but Verify: Introducing DAVinCI - A Framework for Dual Attribution and Verification in Claim Inference for Language Models

Vipula Rawte, Ryan A. Rossi, Franck Dernoncourt, Nedim Lipka


Abstract
Large Language Models (LLMs) have demonstrated remarkable fluency and versatility across a wide range of NLP tasks, yet they remain prone to factual inaccuracies and hallucinations. This limitation poses significant risks in high-stakes domains such as healthcare, law, and scientific communication, where trust and verifiability are paramount. In this paper, we introduce DAVinCI - a Dual Attribution and Verification framework designed to enhance the factual reliability and interpretability of LLM outputs. DAVinCI operates in two stages: (i) it attributes generated claims to internal model components and external sources; (ii) it verifies each claim using entailment-based reasoning and confidence calibration. We evaluate DAVinCI across multiple datasets, including FEVER and CLIMATE-FEVER, and compare its performance against standard verification-only baselines. Our results show that DAVinCI significantly improves classification accuracy, attribution precision, recall, and F1-score by 5-20%. Through an extensive ablation study, we isolate the contributions of evidence span selection, recalibration thresholds, and retrieval quality. We also release a modular DAVinCI implementation that can be integrated into existing LLM pipelines. By bridging attribution and verification, DAVinCI offers a scalable path to auditable, trustworthy AI systems. This work contributes to the growing effort to make LLMs not only powerful but also accountable. Our code is available at https://github.com/vr25/davinci.
Anthology ID:
2026.groundlm-1.10
Volume:
Proceedings of the 1st Workshop on Grounding Language Models: Learning Faithfully and Efficiently (GroundLM 2026)
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Yimu Wang, Yee Man Choi, Di Wu, Siqi Ouyang, Mozhgan Nasr Azadani, Yi R. (May) Fung
Venues:
GroundLM | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
132–140
Language:
URL:
https://aclanthology.org/2026.groundlm-1.10/
DOI:
Bibkey:
Cite (ACL):
Vipula Rawte, Ryan A. Rossi, Franck Dernoncourt, and Nedim Lipka. 2026. Trust but Verify: Introducing DAVinCI - A Framework for Dual Attribution and Verification in Claim Inference for Language Models. In Proceedings of the 1st Workshop on Grounding Language Models: Learning Faithfully and Efficiently (GroundLM 2026), pages 132–140, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Trust but Verify: Introducing DAVinCI - A Framework for Dual Attribution and Verification in Claim Inference for Language Models (Rawte et al., GroundLM 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.groundlm-1.10.pdf