<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="prokopalo-etal-2020-evaluation-lifelong">
    <titleInfo>
        <title>Evaluation of Lifelong Learning Systems</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Yevhenii</namePart>
        <namePart type="family">Prokopalo</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Sylvain</namePart>
        <namePart type="family">Meignier</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Olivier</namePart>
        <namePart type="family">Galibert</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Loic</namePart>
        <namePart type="family">Barrault</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Anthony</namePart>
        <namePart type="family">Larcher</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2020-05</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <language>
        <languageTerm type="text">English</languageTerm>
        <languageTerm type="code" authority="iso639-2b">eng</languageTerm>
    </language>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the Twelfth Language Resources and Evaluation Conference</title>
        </titleInfo>
        <originInfo>
            <publisher>European Language Resources Association</publisher>
            <place>
                <placeTerm type="text">Marseille, France</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
        <identifier type="isbn">979-10-95546-34-4</identifier>
    </relatedItem>
    <abstract>Current intelligent systems need the expensive support of machine learning experts to sustain their performance level when used on a daily basis. To reduce this cost, i.e. remaining free from any machine learning expert, it is reasonable to implement lifelong (or continuous) learning intelligent systems that will continuously adapt their model when facing changing execution conditions. In this work, the systems are allowed to refer to human domain experts who can provide the system with relevant knowledge about the task. Nowadays, the fast growth of lifelong learning systems development rises the question of their evaluation. In this article we propose a generic evaluation methodology for the specific case of lifelong learning systems. Two steps will be considered. First, the evaluation of human-assisted learning (including active and/or interactive learning) outside the context of lifelong learning. Second, the system evaluation across time, with propositions of how a lifelong learning intelligent system should be evaluated when including human assisted learning or not.</abstract>
    <identifier type="citekey">prokopalo-etal-2020-evaluation-lifelong</identifier>
    <location>
        <url>https://aclanthology.org/2020.lrec-1.226</url>
    </location>
    <part>
        <date>2020-05</date>
        <extent unit="page">
            <start>1833</start>
            <end>1841</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T Evaluation of Lifelong Learning Systems
%A Prokopalo, Yevhenii
%A Meignier, Sylvain
%A Galibert, Olivier
%A Barrault, Loic
%A Larcher, Anthony
%S Proceedings of the Twelfth Language Resources and Evaluation Conference
%D 2020
%8 May
%I European Language Resources Association
%C Marseille, France
%@ 979-10-95546-34-4
%G English
%F prokopalo-etal-2020-evaluation-lifelong
%X Current intelligent systems need the expensive support of machine learning experts to sustain their performance level when used on a daily basis. To reduce this cost, i.e. remaining free from any machine learning expert, it is reasonable to implement lifelong (or continuous) learning intelligent systems that will continuously adapt their model when facing changing execution conditions. In this work, the systems are allowed to refer to human domain experts who can provide the system with relevant knowledge about the task. Nowadays, the fast growth of lifelong learning systems development rises the question of their evaluation. In this article we propose a generic evaluation methodology for the specific case of lifelong learning systems. Two steps will be considered. First, the evaluation of human-assisted learning (including active and/or interactive learning) outside the context of lifelong learning. Second, the system evaluation across time, with propositions of how a lifelong learning intelligent system should be evaluated when including human assisted learning or not.
%U https://aclanthology.org/2020.lrec-1.226
%P 1833-1841

Markdown (Informal)

[Evaluation of Lifelong Learning Systems](https://aclanthology.org/2020.lrec-1.226) (Prokopalo et al., LREC 2020)

• Evaluation of Lifelong Learning Systems (Prokopalo et al., LREC 2020)

ACL

• Yevhenii Prokopalo, Sylvain Meignier, Olivier Galibert, Loic Barrault, and Anthony Larcher. 2020. Evaluation of Lifelong Learning Systems. In Proceedings of the Twelfth Language Resources and Evaluation Conference, pages 1833–1841, Marseille, France. European Language Resources Association.