<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="tate-2008-statistical">
    <titleInfo>
        <title>A Statistical Analysis of Automated MT Evaluation Metrics for Assessments in Task-Based MT Evaluation</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Calandra</namePart>
        <namePart type="given">R</namePart>
        <namePart type="family">Tate</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2008-oct 21-25</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the 8th Conference of the Association for Machine Translation in the Americas: Research Papers</title>
        </titleInfo>
        <originInfo>
            <publisher>Association for Machine Translation in the Americas</publisher>
            <place>
                <placeTerm type="text">Waikiki, USA</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>This paper applies nonparametric statistical techniques to Machine Translation (MT) Evaluation using data from a large scale task-based study. In particular, the relationship between human task performance on an information extraction task with translated documents and well-known automated translation evaluation metric scores for those documents is studied. Findings from a correlation analysis of this connection are presented and contrasted with current strategies for evaluating translations. An extended analysis that involves a novel idea for assessing partial rank correlation within the presence of grouping factors is also discussed. This work exposes the limitations of descriptive statistics generally used in this area, mainly correlation analysis, when using automated metrics for assessments in task handling purposes.</abstract>
    <identifier type="citekey">tate-2008-statistical</identifier>
    <location>
        <url>https://aclanthology.org/2008.amta-papers.17</url>
    </location>
    <part>
        <date>2008-oct 21-25</date>
        <extent unit="page">
            <start>182</start>
            <end>191</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T A Statistical Analysis of Automated MT Evaluation Metrics for Assessments in Task-Based MT Evaluation
%A Tate, Calandra R.
%S Proceedings of the 8th Conference of the Association for Machine Translation in the Americas: Research Papers
%D 2008
%8 oct 21 25
%I Association for Machine Translation in the Americas
%C Waikiki, USA
%F tate-2008-statistical
%X This paper applies nonparametric statistical techniques to Machine Translation (MT) Evaluation using data from a large scale task-based study. In particular, the relationship between human task performance on an information extraction task with translated documents and well-known automated translation evaluation metric scores for those documents is studied. Findings from a correlation analysis of this connection are presented and contrasted with current strategies for evaluating translations. An extended analysis that involves a novel idea for assessing partial rank correlation within the presence of grouping factors is also discussed. This work exposes the limitations of descriptive statistics generally used in this area, mainly correlation analysis, when using automated metrics for assessments in task handling purposes.
%U https://aclanthology.org/2008.amta-papers.17
%P 182-191

Markdown (Informal)

[A Statistical Analysis of Automated MT Evaluation Metrics for Assessments in Task-Based MT Evaluation](https://aclanthology.org/2008.amta-papers.17) (Tate, AMTA 2008)

• A Statistical Analysis of Automated MT Evaluation Metrics for Assessments in Task-Based MT Evaluation (Tate, AMTA 2008)

ACL

• Calandra R. Tate. 2008. A Statistical Analysis of Automated MT Evaluation Metrics for Assessments in Task-Based MT Evaluation. In Proceedings of the 8th Conference of the Association for Machine Translation in the Americas: Research Papers, pages 182–191, Waikiki, USA. Association for Machine Translation in the Americas.