COVER-KBC: Evidence-Centric Adaptive Inference for Closed-Book Knowledge Base Construction

Quoc-Linh Vo


Abstract
Large Language Models (LLMs) encode substantial factual knowledge, but reliably extracting complete knowledge-base entries remains challenging when relations differ in cardinality, semantics, and missingness. We present COVER-KBC, our system for the AKBC Shared Task 2026, which formulates closed-book knowledge extraction as relation-typed, evidence-centric inference. Each relation is compiled into an inference program that controls elicitation, verification, stopping, and final selection. Model observations are accumulated in a provenance-aware evidence state and scored using independent support, calibrated verification, contradiction, and disagreement. To distinguish candidate correctness from answer-space completeness, COVER-KBC estimates residual search need and uses a budget-aware controller to adaptively acquire further evidence when necessary. Relation-specific finalization handles heterogeneous output structures and difficult numeric or nullable cases. Using a single Mistral-Small-3.2-24B checkpoint without additional training or external retrieval, COVER-KBC achieves a Macro-F1 of 0.5878 on the hidden test set. Our implementation is available at https://github.com/vquclinh/cover-kbc.
Anthology ID:
2026.akbc-1.37
Volume:
Proceedings of the 11th Workshop on Automated Knowledge Base Construction (AKBC 2026)
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Jan-Christoph Kalo, Ndapa Nakashole, Simon Razniewski, Fabian M. Suchanek, Andreas Vlachos, Andrew McCallum
Venues:
AKBC | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
480–487
Language:
URL:
https://aclanthology.org/2026.akbc-1.37/
DOI:
Bibkey:
Cite (ACL):
Quoc-Linh Vo. 2026. COVER-KBC: Evidence-Centric Adaptive Inference for Closed-Book Knowledge Base Construction. In Proceedings of the 11th Workshop on Automated Knowledge Base Construction (AKBC 2026), pages 480–487, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
COVER-KBC: Evidence-Centric Adaptive Inference for Closed-Book Knowledge Base Construction (Vo, AKBC 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.akbc-1.37.pdf