<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="sanchez-montero-etal-2026-creation">
    <titleInfo>
        <title>Creation and Validation of a Monolingual Spanish NLI Dataset for Metaphor Interpretation via Model-in-the-Loop</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Alec</namePart>
        <namePart type="family">Sanchez-Montero</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Gemma</namePart>
        <namePart type="family">Bel-Enguix</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Sergio</namePart>
        <namePart type="given">Luis</namePart>
        <namePart type="family">Ojeda Trueba</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2026-05</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of Learning Non-Literal Expressions with Small Data @ LREC 2026</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Markus</namePart>
            <namePart type="family">Egg</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Valia</namePart>
            <namePart type="family">Kordoni</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>ELRA Language Resources Association (ELRA)</publisher>
            <place>
                <placeTerm type="text">Palma, Mallorca (Spain)</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>Large Language Models (LLMs) can easily generate fluent text, but assessing whether they truly understand metaphors requires moving beyond English-centric datasets and binary token classification tasks. To test if current state-of-the-art models perform genuine structural alignment and analogical reasoning rather than just echoing statistical token co-occurrence, we introduce a new monolingual Spanish Natural Language Inference (NLI) dataset specifically built for metaphor interpretation. Using a Model-in-the-Loop approach, we reconstruct the literal truth conditions of metaphors sourced from science texts. Before human experts curated the data, we performed an ablation study—evaluated via BERTScore and Cross-Entropy—to test whether explicit symbolic scaffolding improves analogical reasoning. While automated evaluations suggested that forcing models to follow explicit metaphorical rules diminished their fluency and increased text surprisal, human evaluation revealed the opposite: this explicit guidance produced far more accurate and strictly literal outputs. This reveals a limitation in how we evaluate NLU: automated metrics consistently penalize the cognitive ‘heavy lifting’ required to resolve a metaphor, simply because they are built to reward surface-level statistical fluency. By releasing this resource, we aim to shift the focus from surface-level generation to real cognitive alignment and metaphorical understanding in Spanish NLU.</abstract>
    <identifier type="citekey">sanchez-montero-etal-2026-creation</identifier>
    <identifier type="doi">10.63317/3j5ogzih7uuv</identifier>
    <location>
        <url>https://aclanthology.org/2026.nonliteral-1.7/</url>
    </location>
    <part>
        <date>2026-05</date>
        <extent unit="page">
            <start>77</start>
            <end>87</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T Creation and Validation of a Monolingual Spanish NLI Dataset for Metaphor Interpretation via Model-in-the-Loop
%A Sanchez-Montero, Alec
%A Bel-Enguix, Gemma
%A Ojeda Trueba, Sergio Luis
%Y Egg, Markus
%Y Kordoni, Valia
%S Proceedings of Learning Non-Literal Expressions with Small Data @ LREC 2026
%D 2026
%8 May
%I ELRA Language Resources Association (ELRA)
%C Palma, Mallorca (Spain)
%F sanchez-montero-etal-2026-creation
%X Large Language Models (LLMs) can easily generate fluent text, but assessing whether they truly understand metaphors requires moving beyond English-centric datasets and binary token classification tasks. To test if current state-of-the-art models perform genuine structural alignment and analogical reasoning rather than just echoing statistical token co-occurrence, we introduce a new monolingual Spanish Natural Language Inference (NLI) dataset specifically built for metaphor interpretation. Using a Model-in-the-Loop approach, we reconstruct the literal truth conditions of metaphors sourced from science texts. Before human experts curated the data, we performed an ablation study—evaluated via BERTScore and Cross-Entropy—to test whether explicit symbolic scaffolding improves analogical reasoning. While automated evaluations suggested that forcing models to follow explicit metaphorical rules diminished their fluency and increased text surprisal, human evaluation revealed the opposite: this explicit guidance produced far more accurate and strictly literal outputs. This reveals a limitation in how we evaluate NLU: automated metrics consistently penalize the cognitive ‘heavy lifting’ required to resolve a metaphor, simply because they are built to reward surface-level statistical fluency. By releasing this resource, we aim to shift the focus from surface-level generation to real cognitive alignment and metaphorical understanding in Spanish NLU.
%R 10.63317/3j5ogzih7uuv
%U https://aclanthology.org/2026.nonliteral-1.7/
%U https://doi.org/10.63317/3j5ogzih7uuv
%P 77-87

Markdown (Informal)

[Creation and Validation of a Monolingual Spanish NLI Dataset for Metaphor Interpretation via Model-in-the-Loop](https://aclanthology.org/2026.nonliteral-1.7/) (Sanchez-Montero et al., NonLiteral 2026)

• Creation and Validation of a Monolingual Spanish NLI Dataset for Metaphor Interpretation via Model-in-the-Loop (Sanchez-Montero et al., NonLiteral 2026)

ACL

• Alec Sanchez-Montero, Gemma Bel-Enguix, and Sergio Luis Ojeda Trueba. 2026. Creation and Validation of a Monolingual Spanish NLI Dataset for Metaphor Interpretation via Model-in-the-Loop. In Proceedings of Learning Non-Literal Expressions with Small Data @ LREC 2026, pages 77–87, Palma, Mallorca (Spain). ELRA Language Resources Association (ELRA).