<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="kabbach-etal-2019-towards">
    <titleInfo>
        <title>Towards Incremental Learning of Word Embeddings Using Context Informativeness</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Alexandre</namePart>
        <namePart type="family">Kabbach</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Kristina</namePart>
        <namePart type="family">Gulordava</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Aurélie</namePart>
        <namePart type="family">Herbelot</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2019-07</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics: Student Research Workshop</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Fernando</namePart>
            <namePart type="family">Alva-Manchego</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Eunsol</namePart>
            <namePart type="family">Choi</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Daniel</namePart>
            <namePart type="family">Khashabi</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Florence, Italy</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>In this paper, we investigate the task of learning word embeddings from very sparse data in an incremental, cognitively-plausible way. We focus on the notion of ‘informativeness’, that is, the idea that some content is more valuable to the learning process than other. We further highlight the challenges of online learning and argue that previous systems fall short of implementing incrementality. Concretely, we incorporate informativeness in a previously proposed model of nonce learning, using it for context selection and learning rate modulation. We test our system on the task of learning new words from definitions, as well as on the task of learning new words from potentially uninformative contexts. We demonstrate that informativeness is crucial to obtaining state-of-the-art performance in a truly incremental setup.</abstract>
    <identifier type="citekey">kabbach-etal-2019-towards</identifier>
    <identifier type="doi">10.18653/v1/P19-2022</identifier>
    <location>
        <url>https://aclanthology.org/P19-2022</url>
    </location>
    <part>
        <date>2019-07</date>
        <extent unit="page">
            <start>162</start>
            <end>168</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T Towards Incremental Learning of Word Embeddings Using Context Informativeness
%A Kabbach, Alexandre
%A Gulordava, Kristina
%A Herbelot, Aurélie
%Y Alva-Manchego, Fernando
%Y Choi, Eunsol
%Y Khashabi, Daniel
%S Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics: Student Research Workshop
%D 2019
%8 July
%I Association for Computational Linguistics
%C Florence, Italy
%F kabbach-etal-2019-towards
%X In this paper, we investigate the task of learning word embeddings from very sparse data in an incremental, cognitively-plausible way. We focus on the notion of ‘informativeness’, that is, the idea that some content is more valuable to the learning process than other. We further highlight the challenges of online learning and argue that previous systems fall short of implementing incrementality. Concretely, we incorporate informativeness in a previously proposed model of nonce learning, using it for context selection and learning rate modulation. We test our system on the task of learning new words from definitions, as well as on the task of learning new words from potentially uninformative contexts. We demonstrate that informativeness is crucial to obtaining state-of-the-art performance in a truly incremental setup.
%R 10.18653/v1/P19-2022
%U https://aclanthology.org/P19-2022
%U https://doi.org/10.18653/v1/P19-2022
%P 162-168

Markdown (Informal)

[Towards Incremental Learning of Word Embeddings Using Context Informativeness](https://aclanthology.org/P19-2022) (Kabbach et al., ACL 2019)

• Towards Incremental Learning of Word Embeddings Using Context Informativeness (Kabbach et al., ACL 2019)

ACL

• Alexandre Kabbach, Kristina Gulordava, and Aurélie Herbelot. 2019. Towards Incremental Learning of Word Embeddings Using Context Informativeness. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics: Student Research Workshop, pages 162–168, Florence, Italy. Association for Computational Linguistics.