Ensembling Elicitation Strategies for Knowledge Base Construction

Vlad-Mădălin Ungureanu, Matei Neacșu, Ianis Belu


Abstract
Large language models represent a promising alternative for automating structured knowledge bases construction, but their reliance on parametric knowledge makes them susceptible to hallucinations and incomplete information. The Automated Knowledge Base Construction competition investigates the use of large language models to construct structured knowledge bases from their parametric knowledge alone, without fine-tuning or external retrieval. Given a subject–relation pair, participants must predict the complete set of correct objects across several relation types. Our approach proposes an ensemble of four prompting strategies: question-style, masked-style, few-shot chain-of-thought, and least-to-most prompting. It aggregates their predictions using relation-aware majority voting. The resulting system achieves a Macro-F1 of 0.6651 on the test set, substantially outperforming the provided baseline of 0.294.
Anthology ID:
2026.akbc-1.43
Volume:
Proceedings of the 11th Workshop on Automated Knowledge Base Construction (AKBC 2026)
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Jan-Christoph Kalo, Ndapa Nakashole, Simon Razniewski, Fabian M. Suchanek, Andreas Vlachos, Andrew McCallum
Venues:
AKBC | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
543–549
Language:
URL:
https://aclanthology.org/2026.akbc-1.43/
DOI:
Bibkey:
Cite (ACL):
Vlad-Mădălin Ungureanu, Matei Neacșu, and Ianis Belu. 2026. Ensembling Elicitation Strategies for Knowledge Base Construction. In Proceedings of the 11th Workshop on Automated Knowledge Base Construction (AKBC 2026), pages 543–549, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Ensembling Elicitation Strategies for Knowledge Base Construction (Ungureanu et al., AKBC 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.akbc-1.43.pdf