<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="miok-etal-2020-bayesian">
    <titleInfo>
        <title>Bayesian Methods for Semi-supervised Text Annotation</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Kristian</namePart>
        <namePart type="family">Miok</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Gregor</namePart>
        <namePart type="family">Pirs</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Marko</namePart>
        <namePart type="family">Robnik-Sikonja</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2020-12</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the 14th Linguistic Annotation Workshop</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Stefanie</namePart>
            <namePart type="family">Dipper</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Amir</namePart>
            <namePart type="family">Zeldes</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Barcelona, Spain</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>Human annotations are an important source of information in the development of natural language understanding approaches. As under the pressure of productivity annotators can assign different labels to a given text, the quality of produced annotations frequently varies. This is especially the case if decisions are difficult, with high cognitive load, requires awareness of broader context, or careful consideration of background knowledge. To alleviate the problem, we propose two semi-supervised methods to guide the annotation process: a Bayesian deep learning model and a Bayesian ensemble method. Using a Bayesian deep learning method, we can discover annotations that cannot be trusted and might require reannotation. A recently proposed Bayesian ensemble method helps us to combine the annotators’ labels with predictions of trained models. According to the results obtained from three hate speech detection experiments, the proposed Bayesian methods can improve the annotations and prediction performance of BERT models.</abstract>
    <identifier type="citekey">miok-etal-2020-bayesian</identifier>
    <location>
        <url>https://aclanthology.org/2020.law-1.1</url>
    </location>
    <part>
        <date>2020-12</date>
        <extent unit="page">
            <start>1</start>
            <end>12</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T Bayesian Methods for Semi-supervised Text Annotation
%A Miok, Kristian
%A Pirs, Gregor
%A Robnik-Sikonja, Marko
%Y Dipper, Stefanie
%Y Zeldes, Amir
%S Proceedings of the 14th Linguistic Annotation Workshop
%D 2020
%8 December
%I Association for Computational Linguistics
%C Barcelona, Spain
%F miok-etal-2020-bayesian
%X Human annotations are an important source of information in the development of natural language understanding approaches. As under the pressure of productivity annotators can assign different labels to a given text, the quality of produced annotations frequently varies. This is especially the case if decisions are difficult, with high cognitive load, requires awareness of broader context, or careful consideration of background knowledge. To alleviate the problem, we propose two semi-supervised methods to guide the annotation process: a Bayesian deep learning model and a Bayesian ensemble method. Using a Bayesian deep learning method, we can discover annotations that cannot be trusted and might require reannotation. A recently proposed Bayesian ensemble method helps us to combine the annotators’ labels with predictions of trained models. According to the results obtained from three hate speech detection experiments, the proposed Bayesian methods can improve the annotations and prediction performance of BERT models.
%U https://aclanthology.org/2020.law-1.1
%P 1-12

Markdown (Informal)

[Bayesian Methods for Semi-supervised Text Annotation](https://aclanthology.org/2020.law-1.1) (Miok et al., LAW 2020)

• Bayesian Methods for Semi-supervised Text Annotation (Miok et al., LAW 2020)

ACL

• Kristian Miok, Gregor Pirs, and Marko Robnik-Sikonja. 2020. Bayesian Methods for Semi-supervised Text Annotation. In Proceedings of the 14th Linguistic Annotation Workshop, pages 1–12, Barcelona, Spain. Association for Computational Linguistics.