<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="tsygankova-etal-2021-building">
    <titleInfo>
        <title>Building Low-Resource NER Models Using Non-Speaker Annotations</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Tatiana</namePart>
        <namePart type="family">Tsygankova</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Francesca</namePart>
        <namePart type="family">Marini</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Stephen</namePart>
        <namePart type="family">Mayhew</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Dan</namePart>
        <namePart type="family">Roth</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2021-06</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the Second Workshop on Data Science with Human in the Loop: Language Advances</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Eduard</namePart>
            <namePart type="family">Dragut</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Yunyao</namePart>
            <namePart type="family">Li</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Lucian</namePart>
            <namePart type="family">Popa</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Slobodan</namePart>
            <namePart type="family">Vucetic</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Online</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>In low-resource natural language processing (NLP), the key problems are a lack of target language training data, and a lack of native speakers to create it. Cross-lingual methods have had notable success in addressing these concerns, but in certain common circumstances, such as insufficient pre-training corpora or languages far from the source language, their performance suffers. In this work we propose a complementary approach to building low-resource Named Entity Recognition (NER) models using “non-speaker” (NS) annotations, provided by annotators with no prior experience in the target language. We recruit 30 participants in a carefully controlled annotation experiment with Indonesian, Russian, and Hindi. We show that use of NS annotators produces results that are consistently on par or better than cross-lingual methods built on modern contextual representations, and have the potential to outperform with additional effort. We conclude with observations of common annotation patterns and recommended implementation practices, and motivate how NS annotations can be used in addition to prior methods for improved performance.</abstract>
    <identifier type="citekey">tsygankova-etal-2021-building</identifier>
    <identifier type="doi">10.18653/v1/2021.dash-1.11</identifier>
    <location>
        <url>https://aclanthology.org/2021.dash-1.11</url>
    </location>
    <part>
        <date>2021-06</date>
        <extent unit="page">
            <start>62</start>
            <end>69</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T Building Low-Resource NER Models Using Non-Speaker Annotations
%A Tsygankova, Tatiana
%A Marini, Francesca
%A Mayhew, Stephen
%A Roth, Dan
%Y Dragut, Eduard
%Y Li, Yunyao
%Y Popa, Lucian
%Y Vucetic, Slobodan
%S Proceedings of the Second Workshop on Data Science with Human in the Loop: Language Advances
%D 2021
%8 June
%I Association for Computational Linguistics
%C Online
%F tsygankova-etal-2021-building
%X In low-resource natural language processing (NLP), the key problems are a lack of target language training data, and a lack of native speakers to create it. Cross-lingual methods have had notable success in addressing these concerns, but in certain common circumstances, such as insufficient pre-training corpora or languages far from the source language, their performance suffers. In this work we propose a complementary approach to building low-resource Named Entity Recognition (NER) models using “non-speaker” (NS) annotations, provided by annotators with no prior experience in the target language. We recruit 30 participants in a carefully controlled annotation experiment with Indonesian, Russian, and Hindi. We show that use of NS annotators produces results that are consistently on par or better than cross-lingual methods built on modern contextual representations, and have the potential to outperform with additional effort. We conclude with observations of common annotation patterns and recommended implementation practices, and motivate how NS annotations can be used in addition to prior methods for improved performance.
%R 10.18653/v1/2021.dash-1.11
%U https://aclanthology.org/2021.dash-1.11
%U https://doi.org/10.18653/v1/2021.dash-1.11
%P 62-69

Markdown (Informal)

[Building Low-Resource NER Models Using Non-Speaker Annotations](https://aclanthology.org/2021.dash-1.11) (Tsygankova et al., DaSH 2021)

• Building Low-Resource NER Models Using Non-Speaker Annotations (Tsygankova et al., DaSH 2021)

ACL

• Tatiana Tsygankova, Francesca Marini, Stephen Mayhew, and Dan Roth. 2021. Building Low-Resource NER Models Using Non-Speaker Annotations. In Proceedings of the Second Workshop on Data Science with Human in the Loop: Language Advances, pages 62–69, Online. Association for Computational Linguistics.