<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="schluter-2015-critical">
    <titleInfo>
        <title>A critical survey on measuring success in rank-based keyword assignment to documents</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Natalie</namePart>
        <namePart type="family">Schluter</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2015-06</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Actes de la 22e conférence sur le Traitement Automatique des Langues Naturelles. Articles courts</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Jean-Marc</namePart>
            <namePart type="family">Lecarpentier</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Nadine</namePart>
            <namePart type="family">Lucas</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>ATALA</publisher>
            <place>
                <placeTerm type="text">Caen, France</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>Evaluation approaches for unsupervised rank-based keyword assignment are nearly as numerous as are the existing systems. The prolific production of each newly used metric (or metric twist) seems to stem from general dis-satisfaction with the previous one and the source of that dissatisfaction has not previously been discussed in the literature. The difficulty may stem from a poor specification of the keyword assignment task in view of the rank-based approach. With a more complete specification of this task, we aim to show why the previous evaluation metrics fail to satisfy researchers’ goals to distinguish and detect good rank-based keyword assignment systems. We put forward a characterisation of an ideal evaluation metric, and discuss the consistency of the evaluation metrics with this ideal, finding that the average standard normalised cumulative gain metric is most consistent with this ideal.</abstract>
    <identifier type="citekey">schluter-2015-critical</identifier>
    <location>
        <url>https://aclanthology.org/2015.jeptalnrecital-court.9</url>
    </location>
    <part>
        <date>2015-06</date>
        <extent unit="page">
            <start>55</start>
            <end>60</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T A critical survey on measuring success in rank-based keyword assignment to documents
%A Schluter, Natalie
%Y Lecarpentier, Jean-Marc
%Y Lucas, Nadine
%S Actes de la 22e conférence sur le Traitement Automatique des Langues Naturelles. Articles courts
%D 2015
%8 June
%I ATALA
%C Caen, France
%F schluter-2015-critical
%X Evaluation approaches for unsupervised rank-based keyword assignment are nearly as numerous as are the existing systems. The prolific production of each newly used metric (or metric twist) seems to stem from general dis-satisfaction with the previous one and the source of that dissatisfaction has not previously been discussed in the literature. The difficulty may stem from a poor specification of the keyword assignment task in view of the rank-based approach. With a more complete specification of this task, we aim to show why the previous evaluation metrics fail to satisfy researchers’ goals to distinguish and detect good rank-based keyword assignment systems. We put forward a characterisation of an ideal evaluation metric, and discuss the consistency of the evaluation metrics with this ideal, finding that the average standard normalised cumulative gain metric is most consistent with this ideal.
%U https://aclanthology.org/2015.jeptalnrecital-court.9
%P 55-60

Markdown (Informal)

[A critical survey on measuring success in rank-based keyword assignment to documents](https://aclanthology.org/2015.jeptalnrecital-court.9) (Schluter, JEP/TALN/RECITAL 2015)

• A critical survey on measuring success in rank-based keyword assignment to documents (Schluter, JEP/TALN/RECITAL 2015)

ACL

• Natalie Schluter. 2015. A critical survey on measuring success in rank-based keyword assignment to documents. In Actes de la 22e conférence sur le Traitement Automatique des Langues Naturelles. Articles courts, pages 55–60, Caen, France. ATALA.