<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="weissweiler-etal-2025-hybrid">
    <titleInfo>
        <title>Hybrid Human-LLM Corpus Construction and LLM Evaluation for the Caused-Motion Construction</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Leonie</namePart>
        <namePart type="family">Weissweiler</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Abdullatif</namePart>
        <namePart type="family">Köksal</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Hinrich</namePart>
        <namePart type="family">Schütze</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2025-12</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <genre authority="bibutilsgt">journal article</genre>
    <relatedItem type="host">
        <titleInfo>
            <title>Northern European Journal of Language Technology</title>
        </titleInfo>
        <originInfo>
            <issuance>continuing</issuance>
            <publisher>Linköping University Electronic Press</publisher>
            <place>
                <placeTerm type="text">Linköping, Sweden</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">periodical</genre>
        <genre authority="bibutilsgt">academic journal</genre>
    </relatedItem>
    <abstract>The caused-motion construction (CMC, “She sneezed the foam off her cappuccino”) is one of the most well-studied constructions in Construction Grammar (CxG). It is a prime example for describing how constructions must carry meaning, as otherwise the fact that “sneeze” in this context takes two arguments and causes motion cannot be explained. We form the hypothesis that this remains challenging even for state-of-the-art Large Language Models (LLMs), for which we devise a test based on substituting the verb with a prototypical motion verb. To be able to perform this test at a statistically significant scale, in the absence of adequate CxG corpora, we develop a novel pipeline of NLP-assisted collection of linguistically annotated text. We show how dependency parsing and LLMs can be used to significantly reduce annotation cost and thus enable the annotation of rare phenomena at scale. We then evaluate OpenAI, Gemma3, Llama3, OLMo2, Mistral and Aya models for their understanding of the CMC using the newly collected corpus. We find that most models struggle with understanding the motion component that the CMC adds to a sentence.</abstract>
    <identifier type="citekey">weissweiler-etal-2025-hybrid</identifier>
    <identifier type="doi">10.3384/nejlt.2000-1533.2025.5256</identifier>
    <location>
        <url>https://aclanthology.org/2025.nejlt-1.2/</url>
    </location>
    <part>
        <date>2025-12</date>
        <detail type="volume"><number>11</number></detail>
        <extent unit="page">
            <start>27</start>
            <end>57</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Journal Article
%T Hybrid Human-LLM Corpus Construction and LLM Evaluation for the Caused-Motion Construction
%A Weissweiler, Leonie
%A Köksal, Abdullatif
%A Schütze, Hinrich
%J Northern European Journal of Language Technology
%D 2025
%8 December
%V 11
%I Linköping University Electronic Press
%C Linköping, Sweden
%F weissweiler-etal-2025-hybrid
%X The caused-motion construction (CMC, “She sneezed the foam off her cappuccino”) is one of the most well-studied constructions in Construction Grammar (CxG). It is a prime example for describing how constructions must carry meaning, as otherwise the fact that “sneeze” in this context takes two arguments and causes motion cannot be explained. We form the hypothesis that this remains challenging even for state-of-the-art Large Language Models (LLMs), for which we devise a test based on substituting the verb with a prototypical motion verb. To be able to perform this test at a statistically significant scale, in the absence of adequate CxG corpora, we develop a novel pipeline of NLP-assisted collection of linguistically annotated text. We show how dependency parsing and LLMs can be used to significantly reduce annotation cost and thus enable the annotation of rare phenomena at scale. We then evaluate OpenAI, Gemma3, Llama3, OLMo2, Mistral and Aya models for their understanding of the CMC using the newly collected corpus. We find that most models struggle with understanding the motion component that the CMC adds to a sentence.
%R 10.3384/nejlt.2000-1533.2025.5256
%U https://aclanthology.org/2025.nejlt-1.2/
%U https://doi.org/10.3384/nejlt.2000-1533.2025.5256
%P 27-57

Markdown (Informal)

[Hybrid Human-LLM Corpus Construction and LLM Evaluation for the Caused-Motion Construction](https://aclanthology.org/2025.nejlt-1.2/) (Weissweiler et al., NEJLT 2025)

• Hybrid Human-LLM Corpus Construction and LLM Evaluation for the Caused-Motion Construction (Weissweiler et al., NEJLT 2025)

ACL

• Leonie Weissweiler, Abdullatif Köksal, and Hinrich Schütze. 2025. Hybrid Human-LLM Corpus Construction and LLM Evaluation for the Caused-Motion Construction. Northern European Journal of Language Technology, 11:27–57.