Summary of the AKBC 2026 Shared Task: Language Models for Knowledge Base Construction (LM-KBC, 5th Edition)

Jan-Christoph Kalo, Simon Razniewski, Bohui Zhang, Tuan-Phong Nguyen


Abstract
Pretrained language models (LMs) have significantly advanced a variety of knowledge engineering tasks and have shown promise as sources of factual knowledge. While prior work has studied factual knowledge through probing and prompting, reliably constructing complete knowledge bases from the parametric knowledge of LMs remains challenging. The AKBC 2026 Shared Task invited participants to construct knowledge bases directly from LMs, given specific subjects and relations. Unlike existing probing benchmarks, the challenge imposed no simplifying assumptions on relation cardinality, allowing a subject entity to be associated with zero, one, or multiple objects, including long answer sets. To ensure accessibility, the challenge featured a single track using open-weight LMs with a total neural parameter budget of up to 32B. Nineteen submissions were received, of which twelve were ranked, exploring a variety of approaches including relation-specific prompting, evidence aggregation, and model selection.
Anthology ID:
2026.akbc-1.28
Volume:
Proceedings of the 11th Workshop on Automated Knowledge Base Construction (AKBC 2026)
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Jan-Christoph Kalo, Ndapa Nakashole, Simon Razniewski, Fabian M. Suchanek, Andreas Vlachos, Andrew McCallum
Venues:
AKBC | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
409–416
Language:
URL:
https://aclanthology.org/2026.akbc-1.28/
DOI:
Bibkey:
Cite (ACL):
Jan-Christoph Kalo, Simon Razniewski, Bohui Zhang, and Tuan-Phong Nguyen. 2026. Summary of the AKBC 2026 Shared Task: Language Models for Knowledge Base Construction (LM-KBC, 5th Edition). In Proceedings of the 11th Workshop on Automated Knowledge Base Construction (AKBC 2026), pages 409–416, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Summary of the AKBC 2026 Shared Task: Language Models for Knowledge Base Construction (LM-KBC, 5th Edition) (Kalo et al., AKBC 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.akbc-1.28.pdf