<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="dessi-ozsoy-2026-improving">
    <titleInfo>
        <title>Improving Text2Cypher with Confidence-Based Test-Time Strategies</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Rima</namePart>
        <namePart type="family">Dessi</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Makbule</namePart>
        <namePart type="given">Gulcin</namePart>
        <namePart type="family">Ozsoy</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2026-05</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the Knowledge Graphs and Large Language Models Workshop (KG-LLM) @ LREC26</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Gilles</namePart>
            <namePart type="family">Sérasset</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Katerina</namePart>
            <namePart type="family">Gkirtzou</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Michael</namePart>
            <namePart type="family">Cochez</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Jan-Christoph</namePart>
            <namePart type="family">Kalo</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>ELRA Language Resources Association (ELRA)</publisher>
            <place>
                <placeTerm type="text">Palma, Mallorca (Spain)</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>Advances in Large Language Models (LLMs) have made it possible to convert natural language questions into executable database queries. Text2Cypher focuses on graph databases, converting user questions into queries and providing natural language access to graph-structured data. While significant progress has been made through prompt design, fine-tuning, and iterative refinement, less attention has been given to adaptive test-time strategies that combine multiple generated outputs. In this work, we investigate the impact of confidence-based test-time strategies specifically on the Text2Cypher task by evaluating the model’s traces, which are the sequence of tokens generated during the construction of the query. We show that reasoning models generate diverse query candidates but frequently produce syntactic errors and incomplete structures, limiting executability. On the other hand, instruction-tuned models yield more reliable outputs but lack sufficient diversity for effective confidence-based selection. Further, by tuning diversity parameters such as top-p and temperature, we observe consistent improvements in both query accuracy and execution success. Experiments across multiple instruction-tuned models confirm that combining diversity-controlled generation with confidence-aware inference provides a practical, model-agnostic method for improving query generation.</abstract>
    <identifier type="citekey">dessi-ozsoy-2026-improving</identifier>
    <identifier type="doi">10.63317/2sw2u84kovdb</identifier>
    <location>
        <url>https://aclanthology.org/2026.kallm-1.5/</url>
    </location>
    <part>
        <date>2026-05</date>
        <extent unit="page">
            <start>45</start>
            <end>52</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T Improving Text2Cypher with Confidence-Based Test-Time Strategies
%A Dessi, Rima
%A Ozsoy, Makbule Gulcin
%Y Sérasset, Gilles
%Y Gkirtzou, Katerina
%Y Cochez, Michael
%Y Kalo, Jan-Christoph
%S Proceedings of the Knowledge Graphs and Large Language Models Workshop (KG-LLM) @ LREC26
%D 2026
%8 May
%I ELRA Language Resources Association (ELRA)
%C Palma, Mallorca (Spain)
%F dessi-ozsoy-2026-improving
%X Advances in Large Language Models (LLMs) have made it possible to convert natural language questions into executable database queries. Text2Cypher focuses on graph databases, converting user questions into queries and providing natural language access to graph-structured data. While significant progress has been made through prompt design, fine-tuning, and iterative refinement, less attention has been given to adaptive test-time strategies that combine multiple generated outputs. In this work, we investigate the impact of confidence-based test-time strategies specifically on the Text2Cypher task by evaluating the model’s traces, which are the sequence of tokens generated during the construction of the query. We show that reasoning models generate diverse query candidates but frequently produce syntactic errors and incomplete structures, limiting executability. On the other hand, instruction-tuned models yield more reliable outputs but lack sufficient diversity for effective confidence-based selection. Further, by tuning diversity parameters such as top-p and temperature, we observe consistent improvements in both query accuracy and execution success. Experiments across multiple instruction-tuned models confirm that combining diversity-controlled generation with confidence-aware inference provides a practical, model-agnostic method for improving query generation.
%R 10.63317/2sw2u84kovdb
%U https://aclanthology.org/2026.kallm-1.5/
%U https://doi.org/10.63317/2sw2u84kovdb
%P 45-52

Markdown (Informal)

[Improving Text2Cypher with Confidence-Based Test-Time Strategies](https://aclanthology.org/2026.kallm-1.5/) (Dessi & Ozsoy, KaLLM 2026)

• Improving Text2Cypher with Confidence-Based Test-Time Strategies (Dessi & Ozsoy, KaLLM 2026)

ACL

• Rima Dessi and Makbule Gulcin Ozsoy. 2026. Improving Text2Cypher with Confidence-Based Test-Time Strategies. In Proceedings of the Knowledge Graphs and Large Language Models Workshop (KG-LLM) @ LREC26, pages 45–52, Palma, Mallorca (Spain). ELRA Language Resources Association (ELRA).