<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="luo-etal-2019-semi">
    <titleInfo>
        <title>Semi-Supervised Teacher-Student Architecture for Relation Extraction</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Fan</namePart>
        <namePart type="family">Luo</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Ajay</namePart>
        <namePart type="family">Nagesh</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Rebecca</namePart>
        <namePart type="family">Sharp</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Mihai</namePart>
        <namePart type="family">Surdeanu</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2019-06</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the Third Workshop on Structured Prediction for NLP</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Andre</namePart>
            <namePart type="family">Martins</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Andreas</namePart>
            <namePart type="family">Vlachos</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Zornitsa</namePart>
            <namePart type="family">Kozareva</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Sujith</namePart>
            <namePart type="family">Ravi</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Gerasimos</namePart>
            <namePart type="family">Lampouras</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Vlad</namePart>
            <namePart type="family">Niculae</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Julia</namePart>
            <namePart type="family">Kreutzer</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Minneapolis, Minnesota</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>Generating a large amount of training data for information extraction (IE) is either costly (if annotations are created manually), or runs the risk of introducing noisy instances (if distant supervision is used). On the other hand, semi-supervised learning (SSL) is a cost-efficient solution to combat lack of training data. In this paper, we adapt Mean Teacher (Tarvainen and Valpola, 2017), a denoising SSL framework to extract semantic relations between pairs of entities. We explore the sweet spot of amount of supervision required for good performance on this binary relation extraction task. Additionally, different syntax representations are incorporated into our models to enhance the learned representation of sentences. We evaluate our approach on the Google-IISc Distant Supervision (GDS) dataset, which removes test data noise present in all previous distance supervision datasets, which makes it a reliable evaluation benchmark (Jat et al., 2017). Our results show that the SSL Mean Teacher approach nears the performance of fully-supervised approaches even with only 10% of the labeled corpus. Further, the syntax-aware model outperforms other syntax-free approaches across all levels of supervision.</abstract>
    <identifier type="citekey">luo-etal-2019-semi</identifier>
    <identifier type="doi">10.18653/v1/W19-1505</identifier>
    <location>
        <url>https://aclanthology.org/W19-1505</url>
    </location>
    <part>
        <date>2019-06</date>
        <extent unit="page">
            <start>29</start>
            <end>37</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T Semi-Supervised Teacher-Student Architecture for Relation Extraction
%A Luo, Fan
%A Nagesh, Ajay
%A Sharp, Rebecca
%A Surdeanu, Mihai
%Y Martins, Andre
%Y Vlachos, Andreas
%Y Kozareva, Zornitsa
%Y Ravi, Sujith
%Y Lampouras, Gerasimos
%Y Niculae, Vlad
%Y Kreutzer, Julia
%S Proceedings of the Third Workshop on Structured Prediction for NLP
%D 2019
%8 June
%I Association for Computational Linguistics
%C Minneapolis, Minnesota
%F luo-etal-2019-semi
%X Generating a large amount of training data for information extraction (IE) is either costly (if annotations are created manually), or runs the risk of introducing noisy instances (if distant supervision is used). On the other hand, semi-supervised learning (SSL) is a cost-efficient solution to combat lack of training data. In this paper, we adapt Mean Teacher (Tarvainen and Valpola, 2017), a denoising SSL framework to extract semantic relations between pairs of entities. We explore the sweet spot of amount of supervision required for good performance on this binary relation extraction task. Additionally, different syntax representations are incorporated into our models to enhance the learned representation of sentences. We evaluate our approach on the Google-IISc Distant Supervision (GDS) dataset, which removes test data noise present in all previous distance supervision datasets, which makes it a reliable evaluation benchmark (Jat et al., 2017). Our results show that the SSL Mean Teacher approach nears the performance of fully-supervised approaches even with only 10% of the labeled corpus. Further, the syntax-aware model outperforms other syntax-free approaches across all levels of supervision.
%R 10.18653/v1/W19-1505
%U https://aclanthology.org/W19-1505
%U https://doi.org/10.18653/v1/W19-1505
%P 29-37

Markdown (Informal)

[Semi-Supervised Teacher-Student Architecture for Relation Extraction](https://aclanthology.org/W19-1505) (Luo et al., NAACL 2019)

• Semi-Supervised Teacher-Student Architecture for Relation Extraction (Luo et al., NAACL 2019)

ACL

• Fan Luo, Ajay Nagesh, Rebecca Sharp, and Mihai Surdeanu. 2019. Semi-Supervised Teacher-Student Architecture for Relation Extraction. In Proceedings of the Third Workshop on Structured Prediction for NLP, pages 29–37, Minneapolis, Minnesota. Association for Computational Linguistics.