DataMind at AKBC Shared Task 2026: Relation-Specific Multiple Prompting for Closed-Book Knowledge Base Completion

Tanaree Patcharatrakul, Peerapon Vateekul


Abstract
We describe a system for the AKBC Shared Task 2026. The task is to predict complete sets of knowledge base objects from parametric memory alone, with no retrieval and no fine-tuning, across six relations and within a 32B parameter budget. Our system combines relation-specific multiple prompting, consistency-based aggregation, and error-driven prompt refinement. For each relation, multiple prompt variants and samples elicit complementary predictions, with cross-prompt agreement reducing wording-specific errors and cross-sample agreement filtering unstable guesses. Aggregation is tailored to each relation, including cluster-median aggregation for numeric values and voting for categorical and set-valued outputs. The system achieves a validation macro-F1 of 0.5577 and a test macro-F1 of 0.5699, compared to organizer baselines of 0.3131 (validation) and 0.2964 (test).
Anthology ID:
2026.akbc-1.44
Volume:
Proceedings of the 11th Workshop on Automated Knowledge Base Construction (AKBC 2026)
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Jan-Christoph Kalo, Ndapa Nakashole, Simon Razniewski, Fabian M. Suchanek, Andreas Vlachos, Andrew McCallum
Venues:
AKBC | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
550–559
Language:
URL:
https://aclanthology.org/2026.akbc-1.44/
DOI:
Bibkey:
Cite (ACL):
Tanaree Patcharatrakul and Peerapon Vateekul. 2026. DataMind at AKBC Shared Task 2026: Relation-Specific Multiple Prompting for Closed-Book Knowledge Base Completion. In Proceedings of the 11th Workshop on Automated Knowledge Base Construction (AKBC 2026), pages 550–559, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
DataMind at AKBC Shared Task 2026: Relation-Specific Multiple Prompting for Closed-Book Knowledge Base Completion (Patcharatrakul & Vateekul, AKBC 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.akbc-1.44.pdf