<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="creanga-dinu-2024-designing">
    <titleInfo>
        <title>Designing NLP Systems That Adapt to Diverse Worldviews</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Claudiu</namePart>
        <namePart type="family">Creanga</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Liviu</namePart>
        <namePart type="given">P</namePart>
        <namePart type="family">Dinu</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2024-05</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the 3rd Workshop on Perspectivist Approaches to NLP (NLPerspectives) @ LREC-COLING 2024</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Gavin</namePart>
            <namePart type="family">Abercrombie</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Valerio</namePart>
            <namePart type="family">Basile</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Davide</namePart>
            <namePart type="family">Bernadi</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Shiran</namePart>
            <namePart type="family">Dudy</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Simona</namePart>
            <namePart type="family">Frenda</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Lucy</namePart>
            <namePart type="family">Havens</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Sara</namePart>
            <namePart type="family">Tonelli</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>ELRA and ICCL</publisher>
            <place>
                <placeTerm type="text">Torino, Italia</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>Natural Language Inference (NLI) is foundational for evaluating language understanding in AI. However, progress has plateaued, with models failing on ambiguous examples and exhibiting poor generalization. We argue that this stems from disregarding the subjective nature of meaning, which is intrinsically tied to an individual’s weltanschauung (which roughly translates to worldview). Existing NLP datasets often obscure this by aggregating labels or filtering out disagreement. We propose a perspectivist approach: building datasets that capture annotator demographics, values, and justifications for their labels. Such datasets would explicitly model diverse worldviews. Our initial experiments with a subset of the SBIC dataset demonstrate that even limited annotator metadata can improve model performance.</abstract>
    <identifier type="citekey">creanga-dinu-2024-designing</identifier>
    <location>
        <url>https://aclanthology.org/2024.nlperspectives-1.10</url>
    </location>
    <part>
        <date>2024-05</date>
        <extent unit="page">
            <start>95</start>
            <end>99</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T Designing NLP Systems That Adapt to Diverse Worldviews
%A Creanga, Claudiu
%A Dinu, Liviu P.
%Y Abercrombie, Gavin
%Y Basile, Valerio
%Y Bernadi, Davide
%Y Dudy, Shiran
%Y Frenda, Simona
%Y Havens, Lucy
%Y Tonelli, Sara
%S Proceedings of the 3rd Workshop on Perspectivist Approaches to NLP (NLPerspectives) @ LREC-COLING 2024
%D 2024
%8 May
%I ELRA and ICCL
%C Torino, Italia
%F creanga-dinu-2024-designing
%X Natural Language Inference (NLI) is foundational for evaluating language understanding in AI. However, progress has plateaued, with models failing on ambiguous examples and exhibiting poor generalization. We argue that this stems from disregarding the subjective nature of meaning, which is intrinsically tied to an individual’s weltanschauung (which roughly translates to worldview). Existing NLP datasets often obscure this by aggregating labels or filtering out disagreement. We propose a perspectivist approach: building datasets that capture annotator demographics, values, and justifications for their labels. Such datasets would explicitly model diverse worldviews. Our initial experiments with a subset of the SBIC dataset demonstrate that even limited annotator metadata can improve model performance.
%U https://aclanthology.org/2024.nlperspectives-1.10
%P 95-99

Markdown (Informal)

[Designing NLP Systems That Adapt to Diverse Worldviews](https://aclanthology.org/2024.nlperspectives-1.10) (Creanga & Dinu, NLPerspectives-WS 2024)

• Designing NLP Systems That Adapt to Diverse Worldviews (Creanga & Dinu, NLPerspectives-WS 2024)

ACL

• Claudiu Creanga and Liviu P. Dinu. 2024. Designing NLP Systems That Adapt to Diverse Worldviews. In Proceedings of the 3rd Workshop on Perspectivist Approaches to NLP (NLPerspectives) @ LREC-COLING 2024, pages 95–99, Torino, Italia. ELRA and ICCL.