<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="wein-schneider-2022-crowdsourcing">
    <titleInfo>
        <title>Crowdsourcing Preposition Sense Disambiguation with High Precision via a Priming Task</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Shira</namePart>
        <namePart type="family">Wein</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Nathan</namePart>
        <namePart type="family">Schneider</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2022-12</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the Fourth Workshop on Data Science with Human-in-the-Loop (Language Advances)</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Eduard</namePart>
            <namePart type="family">Dragut</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Yunyao</namePart>
            <namePart type="family">Li</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Lucian</namePart>
            <namePart type="family">Popa</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Slobodan</namePart>
            <namePart type="family">Vucetic</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Shashank</namePart>
            <namePart type="family">Srivastava</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Abu Dhabi, United Arab Emirates (Hybrid)</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>The careful design of a crowdsourcing protocol is critical to eliciting highly accurate annotations from untrained workers. In this work, we explore the development of crowdsourcing protocols for a challenging word sense disambiguation task. We find that (a) selecting a similar example usage can serve as a proxy for selecting an explicit definition of the sense, and (b) priming workers with an additional, related task within the HIT improves performance on the main proxy task. Ultimately, we demonstrate the usefulness of our crowdsourcing elicitation technique as an effective alternative to previously investigated training strategies, which can be used if agreement on a challenging task is low.</abstract>
    <identifier type="citekey">wein-schneider-2022-crowdsourcing</identifier>
    <location>
        <url>https://aclanthology.org/2022.dash-1.3</url>
    </location>
    <part>
        <date>2022-12</date>
        <extent unit="page">
            <start>15</start>
            <end>22</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T Crowdsourcing Preposition Sense Disambiguation with High Precision via a Priming Task
%A Wein, Shira
%A Schneider, Nathan
%Y Dragut, Eduard
%Y Li, Yunyao
%Y Popa, Lucian
%Y Vucetic, Slobodan
%Y Srivastava, Shashank
%S Proceedings of the Fourth Workshop on Data Science with Human-in-the-Loop (Language Advances)
%D 2022
%8 December
%I Association for Computational Linguistics
%C Abu Dhabi, United Arab Emirates (Hybrid)
%F wein-schneider-2022-crowdsourcing
%X The careful design of a crowdsourcing protocol is critical to eliciting highly accurate annotations from untrained workers. In this work, we explore the development of crowdsourcing protocols for a challenging word sense disambiguation task. We find that (a) selecting a similar example usage can serve as a proxy for selecting an explicit definition of the sense, and (b) priming workers with an additional, related task within the HIT improves performance on the main proxy task. Ultimately, we demonstrate the usefulness of our crowdsourcing elicitation technique as an effective alternative to previously investigated training strategies, which can be used if agreement on a challenging task is low.
%U https://aclanthology.org/2022.dash-1.3
%P 15-22

Markdown (Informal)

[Crowdsourcing Preposition Sense Disambiguation with High Precision via a Priming Task](https://aclanthology.org/2022.dash-1.3) (Wein & Schneider, DaSH 2022)

• Crowdsourcing Preposition Sense Disambiguation with High Precision via a Priming Task (Wein & Schneider, DaSH 2022)

ACL

• Shira Wein and Nathan Schneider. 2022. Crowdsourcing Preposition Sense Disambiguation with High Precision via a Priming Task. In Proceedings of the Fourth Workshop on Data Science with Human-in-the-Loop (Language Advances), pages 15–22, Abu Dhabi, United Arab Emirates (Hybrid). Association for Computational Linguistics.