Global Consistency Repair for Natural-Language Claim Sets

Paul He, Elke Kirschbaum, Shiva Kasiviswanathan


Abstract
NLP systems increasingly aggregate claims from retrieved passages, documents, and generated reasoning steps. Yet current factuality methods mostly verify claims individually or compare pairs of claims, leaving open the question of whether the entire aggregated claim set can be retained coherently. This misses a fundamental failure mode: claims may be locally plausible and pairwise compatible while still being jointly inconsistent. We formalize global consistency repair: given an inconsistent natural-language claim set, preserve the largest coherent subset while localizing the compact sources of inconsistency. We introduce QXR, an adaptive diagnosis-and-repair framework that treats an LLM as a noisy set-level consistency judge, localizes minimal conflicting subsets, and repairs the claim set by deleting a small hitting set of claims. Across LLM judges and benchmarks derived from VitaminC, FEVER, and conflicting-evidence RAG, QXR preserves substantially more valid claims than direct all-at-once judging while maintaining high precision. These results suggest that factuality in claim aggregation systems should be treated as a set-level repair problem, not only as local verification.
Anthology ID:
2026.emnlp-main.364
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
8339–8358
Language:
URL:
https://aclanthology.org/2026.emnlp-main.364/
DOI:
Bibkey:
Cite (ACL):
Paul He, Elke Kirschbaum, and Shiva Kasiviswanathan. 2026. Global Consistency Repair for Natural-Language Claim Sets. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 8339–8358, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Global Consistency Repair for Natural-Language Claim Sets (He et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.364.pdf