<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="tym-2026-pre">
    <titleInfo>
        <title>Pre-training Aware Directed Reasoning for Closed-Book Knowledge Base Construction</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Mikołaj</namePart>
        <namePart type="family">Tym</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2026-10</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the 11th Workshop on Automated Knowledge Base Construction (AKBC 2026)</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Jan-Christoph</namePart>
            <namePart type="family">Kalo</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Ndapa</namePart>
            <namePart type="family">Nakashole</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Simon</namePart>
            <namePart type="family">Razniewski</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Fabian</namePart>
            <namePart type="given">M</namePart>
            <namePart type="family">Suchanek</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Andreas</namePart>
            <namePart type="family">Vlachos</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Andrew</namePart>
            <namePart type="family">McCallum</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Budapest, Hungary</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
        <identifier type="isbn">979-8-89176-464-4</identifier>
    </relatedItem>
    <abstract>Extracting facts from the parametric memory of Large Language Models (LLMs) for Automated Knowledge Base Completion (AKBC) under closed-book constraints remains a significant challenge. We describe our system for the 2026 AKBC Shared Task, where retrieval, external knowledge sources and fine-tuning are not permitted. We first evaluate 18 open-weight models on the training set to check how much the choice of the model matters for this task. The results differ significantly, from 0.186 to 0.499 macro F1, and the best model is not the largest one. Moreover, the models that score well on coding benchmarks tend to score worse on knowledge base construction. We then introduce Pre-training Aware Directed Reasoning (PADR), a set of relation-specific reasoning pipelines optimized for the best evaluated model, Mistral Small 3.2 24B. PADR improves the macro F1 score on the training set from 0.499 to 0.614. On the shared task’s test set, PADR reaches 0.629 macro F1, more than double the official baseline’s 0.296. The code is available at https://github.com/MikolajTym/akbc-padr.</abstract>
    <identifier type="citekey">tym-2026-pre</identifier>
    <location>
        <url>https://aclanthology.org/2026.akbc-1.35/</url>
    </location>
    <part>
        <date>2026-10</date>
        <extent unit="page">
            <start>462</start>
            <end>472</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T Pre-training Aware Directed Reasoning for Closed-Book Knowledge Base Construction
%A Tym, Mikołaj
%Y Kalo, Jan-Christoph
%Y Nakashole, Ndapa
%Y Razniewski, Simon
%Y Suchanek, Fabian M.
%Y Vlachos, Andreas
%Y McCallum, Andrew
%S Proceedings of the 11th Workshop on Automated Knowledge Base Construction (AKBC 2026)
%D 2026
%8 October
%I Association for Computational Linguistics
%C Budapest, Hungary
%@ 979-8-89176-464-4
%F tym-2026-pre
%X Extracting facts from the parametric memory of Large Language Models (LLMs) for Automated Knowledge Base Completion (AKBC) under closed-book constraints remains a significant challenge. We describe our system for the 2026 AKBC Shared Task, where retrieval, external knowledge sources and fine-tuning are not permitted. We first evaluate 18 open-weight models on the training set to check how much the choice of the model matters for this task. The results differ significantly, from 0.186 to 0.499 macro F1, and the best model is not the largest one. Moreover, the models that score well on coding benchmarks tend to score worse on knowledge base construction. We then introduce Pre-training Aware Directed Reasoning (PADR), a set of relation-specific reasoning pipelines optimized for the best evaluated model, Mistral Small 3.2 24B. PADR improves the macro F1 score on the training set from 0.499 to 0.614. On the shared task’s test set, PADR reaches 0.629 macro F1, more than double the official baseline’s 0.296. The code is available at https://github.com/MikolajTym/akbc-padr.
%U https://aclanthology.org/2026.akbc-1.35/
%P 462-472

Markdown (Informal)

[Pre-training Aware Directed Reasoning for Closed-Book Knowledge Base Construction](https://aclanthology.org/2026.akbc-1.35/) (Tym, AKBC 2026)

• Pre-training Aware Directed Reasoning for Closed-Book Knowledge Base Construction (Tym, AKBC 2026)

ACL

• Mikołaj Tym. 2026. Pre-training Aware Directed Reasoning for Closed-Book Knowledge Base Construction. In Proceedings of the 11th Workshop on Automated Knowledge Base Construction (AKBC 2026), pages 462–472, Budapest, Hungary. Association for Computational Linguistics.