<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="sathyanathan-etal-2026-evaluating">
    <titleInfo>
        <title>Evaluating Reasoning Models for Queries with Presuppositions</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Rose</namePart>
        <namePart type="family">Sathyanathan</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Kinshuk</namePart>
        <namePart type="family">Vasisht</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Danish</namePart>
        <namePart type="family">Pruthi</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2026-07</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Findings of the Association for Computational Linguistics: ACL 2026</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Maria</namePart>
            <namePart type="family">Liakata</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Viviane</namePart>
            <namePart type="given">P</namePart>
            <namePart type="family">Moreira</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Jiajun</namePart>
            <namePart type="family">Zhang</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">David</namePart>
            <namePart type="family">Jurgens</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">San Diego, California, United States</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
        <identifier type="isbn">979-8-89176-395-1</identifier>
    </relatedItem>
    <abstract>Millions of users turn to AI models for their information needs. It is conceivable that a large number of user queries contain assumptions that may be factually inaccurate. Prior work notes that large language models (LLMs) often fail to challenge such erroneous assumptions, and can reinforce users’ misinformed opinions. However, given the recent advances, especially in model’s reasoning capabilities, we revisit whether large reasoning models (LRMs) can reason about the underlying assumptions and respond to user queries appropriately. We construct queries with varying degrees of presuppositions spanning health, science, and general knowledge, and use it to evaluate several widely-deployed models When compared to non-reasoning models, we find that reasoning models achieve a slightly higher accuracy (2-11%), but they still fail to challenge a large fraction (26-42%) of false presuppositions. Further, reasoning models remain susceptible to how strongly the presupposition is expressed.</abstract>
    <identifier type="citekey">sathyanathan-etal-2026-evaluating</identifier>
    <identifier type="doi">10.18653/v1/2026.findings-acl.1201</identifier>
    <location>
        <url>https://aclanthology.org/2026.findings-acl.1201/</url>
    </location>
    <part>
        <date>2026-07</date>
        <extent unit="page">
            <start>23991</start>
            <end>24006</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T Evaluating Reasoning Models for Queries with Presuppositions
%A Sathyanathan, Rose
%A Vasisht, Kinshuk
%A Pruthi, Danish
%Y Liakata, Maria
%Y Moreira, Viviane P.
%Y Zhang, Jiajun
%Y Jurgens, David
%S Findings of the Association for Computational Linguistics: ACL 2026
%D 2026
%8 July
%I Association for Computational Linguistics
%C San Diego, California, United States
%@ 979-8-89176-395-1
%F sathyanathan-etal-2026-evaluating
%X Millions of users turn to AI models for their information needs. It is conceivable that a large number of user queries contain assumptions that may be factually inaccurate. Prior work notes that large language models (LLMs) often fail to challenge such erroneous assumptions, and can reinforce users’ misinformed opinions. However, given the recent advances, especially in model’s reasoning capabilities, we revisit whether large reasoning models (LRMs) can reason about the underlying assumptions and respond to user queries appropriately. We construct queries with varying degrees of presuppositions spanning health, science, and general knowledge, and use it to evaluate several widely-deployed models When compared to non-reasoning models, we find that reasoning models achieve a slightly higher accuracy (2-11%), but they still fail to challenge a large fraction (26-42%) of false presuppositions. Further, reasoning models remain susceptible to how strongly the presupposition is expressed.
%R 10.18653/v1/2026.findings-acl.1201
%U https://aclanthology.org/2026.findings-acl.1201/
%U https://doi.org/10.18653/v1/2026.findings-acl.1201
%P 23991-24006

Markdown (Informal)

[Evaluating Reasoning Models for Queries with Presuppositions](https://aclanthology.org/2026.findings-acl.1201/) (Sathyanathan et al., Findings 2026)

• Evaluating Reasoning Models for Queries with Presuppositions (Sathyanathan et al., Findings 2026)

ACL

• Rose Sathyanathan, Kinshuk Vasisht, and Danish Pruthi. 2026. Evaluating Reasoning Models for Queries with Presuppositions. In Findings of the Association for Computational Linguistics: ACL 2026, pages 23991–24006, San Diego, California, United States. Association for Computational Linguistics.