<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="langlais-gao-2023-rate">
    <titleInfo>
        <title>RaTE: a Reproducible automatic Taxonomy Evaluation by Filling the Gap</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Phillippe</namePart>
        <namePart type="family">Langlais</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Tianjian</namePart>
        <namePart type="given">Lucas</namePart>
        <namePart type="family">Gao</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2023-06</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the 15th International Conference on Computational Semantics</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Maxime</namePart>
            <namePart type="family">Amblard</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <name type="personal">
            <namePart type="given">Ellen</namePart>
            <namePart type="family">Breitholtz</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <publisher>Association for Computational Linguistics</publisher>
            <place>
                <placeTerm type="text">Nancy, France</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>Taxonomies are an essential knowledge representation, yet most studies on automatic taxonomy construction (ATC) resort to manual evaluation to score proposed algorithms. We argue that automatic taxonomy evaluation (ATE) is just as important as taxonomy construction. We propose RaTE, an automatic label-free taxonomy scoring procedure, which relies on a large pre-trained language model. We apply our evaluation procedure to three state-of-the-art ATC algorithms with which we built seven taxonomies from the Yelp domain, and show that 1) RaTE correlates well with human judgments and 2) artificially degrading a taxonomy leads to decreasing RaTE score.</abstract>
    <identifier type="citekey">langlais-gao-2023-rate</identifier>
    <location>
        <url>https://aclanthology.org/2023.iwcs-1.18</url>
    </location>
    <part>
        <date>2023-06</date>
        <extent unit="page">
            <start>173</start>
            <end>182</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T RaTE: a Reproducible automatic Taxonomy Evaluation by Filling the Gap
%A Langlais, Phillippe
%A Gao, Tianjian Lucas
%Y Amblard, Maxime
%Y Breitholtz, Ellen
%S Proceedings of the 15th International Conference on Computational Semantics
%D 2023
%8 June
%I Association for Computational Linguistics
%C Nancy, France
%F langlais-gao-2023-rate
%X Taxonomies are an essential knowledge representation, yet most studies on automatic taxonomy construction (ATC) resort to manual evaluation to score proposed algorithms. We argue that automatic taxonomy evaluation (ATE) is just as important as taxonomy construction. We propose RaTE, an automatic label-free taxonomy scoring procedure, which relies on a large pre-trained language model. We apply our evaluation procedure to three state-of-the-art ATC algorithms with which we built seven taxonomies from the Yelp domain, and show that 1) RaTE correlates well with human judgments and 2) artificially degrading a taxonomy leads to decreasing RaTE score.
%U https://aclanthology.org/2023.iwcs-1.18
%P 173-182

Markdown (Informal)

[RaTE: a Reproducible automatic Taxonomy Evaluation by Filling the Gap](https://aclanthology.org/2023.iwcs-1.18) (Langlais & Gao, IWCS 2023)

• RaTE: a Reproducible automatic Taxonomy Evaluation by Filling the Gap (Langlais & Gao, IWCS 2023)

ACL

• Phillippe Langlais and Tianjian Lucas Gao. 2023. RaTE: a Reproducible automatic Taxonomy Evaluation by Filling the Gap. In Proceedings of the 15th International Conference on Computational Semantics, pages 173–182, Nancy, France. Association for Computational Linguistics.