Evidence-Carrying Claims: Fail-Closed Verification Gates for Language-Model-Assisted Research as Knowledge Base Construction

Robert Sneiderman


Abstract
Language-model-assisted pipelines emit theorems, experiment reports, and literature claims faster than any reviewer pool can check them. This paper argues that the knowledge base such pipelines demand is not a store of extracted facts but a claim ledger: a knowledge base whose entries pair each claim with the artifact that verifies it (a machine-checked proof, a rerunnable receipt, or a resolved forecast) and whose gates fail closed, blocking an unverified claim from entering the record rather than scoring it after the fact. We ground the argument in three mechanisms already running in one research operation: a twenty-two-gate manuscript-admission stack, a Lean 4 library in which the claim is the artifact, and a sealed-prediction registry with forced resolution. We then state what a community-scale claim ledger would require of its schema, its adjudication protocol, and its incentives. The evidence is a single operation and does not establish generalization; the contribution is the knowledge-base-construction framing and the fail-closed gate architecture.
Anthology ID:
2026.akbc-1.14
Volume:
Proceedings of the 11th Workshop on Automated Knowledge Base Construction (AKBC 2026)
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Jan-Christoph Kalo, Ndapa Nakashole, Simon Razniewski, Fabian M. Suchanek, Andreas Vlachos, Andrew McCallum
Venues:
AKBC | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
178–184
Language:
URL:
https://aclanthology.org/2026.akbc-1.14/
DOI:
Bibkey:
Cite (ACL):
Robert Sneiderman. 2026. Evidence-Carrying Claims: Fail-Closed Verification Gates for Language-Model-Assisted Research as Knowledge Base Construction. In Proceedings of the 11th Workshop on Automated Knowledge Base Construction (AKBC 2026), pages 178–184, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Evidence-Carrying Claims: Fail-Closed Verification Gates for Language-Model-Assisted Research as Knowledge Base Construction (Sneiderman, AKBC 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.akbc-1.14.pdf