<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="miller-vanni-2001-scaling">
    <titleInfo>
        <title>Scaling the ISLE taxonomy: development of metrics for the multi-dimensional characterization of machine translation quality</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Keith</namePart>
        <namePart type="given">J</namePart>
        <namePart type="family">Miller</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Michelle</namePart>
        <namePart type="family">Vanni</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2001-sep 18-22</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of Machine Translation Summit VIII</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Bente</namePart>
            <namePart type="family">Maegaard</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <place>
                <placeTerm type="text">Santiago de Compostela, Spain</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>The DARPA MT evaluations of the early 1990s, along with subsequent work on the MT Scale, and the International Standards for Language Engineering (ISLE) MT Evaluation framework represent two of the principal efforts in Machine Translation Evaluation (MTE) over the past decade. We describe a research program that builds on both of these efforts. This paper focuses on the selection of MT output features suggested in the ISLE framework, as well as the development of metrics for the features to be used in the study. We define each metric and describe the rationale for its development. We also discuss several of the finer points of the evaluation measures that arose as a result of verification of the measures against sample output texts from three machine translation systems.</abstract>
    <identifier type="citekey">miller-vanni-2001-scaling</identifier>
    <location>
        <url>https://aclanthology.org/2001.mtsummit-papers.42</url>
    </location>
    <part>
        <date>2001-sep 18-22</date>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T Scaling the ISLE taxonomy: development of metrics for the multi-dimensional characterization of machine translation quality
%A Miller, Keith J.
%A Vanni, Michelle
%Y Maegaard, Bente
%S Proceedings of Machine Translation Summit VIII
%D 2001
%8 sep 18 22
%C Santiago de Compostela, Spain
%F miller-vanni-2001-scaling
%X The DARPA MT evaluations of the early 1990s, along with subsequent work on the MT Scale, and the International Standards for Language Engineering (ISLE) MT Evaluation framework represent two of the principal efforts in Machine Translation Evaluation (MTE) over the past decade. We describe a research program that builds on both of these efforts. This paper focuses on the selection of MT output features suggested in the ISLE framework, as well as the development of metrics for the features to be used in the study. We define each metric and describe the rationale for its development. We also discuss several of the finer points of the evaluation measures that arose as a result of verification of the measures against sample output texts from three machine translation systems.
%U https://aclanthology.org/2001.mtsummit-papers.42

Markdown (Informal)

[Scaling the ISLE taxonomy: development of metrics for the multi-dimensional characterization of machine translation quality](https://aclanthology.org/2001.mtsummit-papers.42) (Miller & Vanni, MTSummit 2001)

• Scaling the ISLE taxonomy: development of metrics for the multi-dimensional characterization of machine translation quality (Miller & Vanni, MTSummit 2001)

ACL

• Keith J. Miller and Michelle Vanni. 2001. Scaling the ISLE taxonomy: development of metrics for the multi-dimensional characterization of machine translation quality. In Proceedings of Machine Translation Summit VIII, Santiago de Compostela, Spain.