<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="koehn-2012-simulating">
    <titleInfo>
        <title>Simulating human judgment in machine translation evaluation campaigns</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Philipp</namePart>
        <namePart type="family">Koehn</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2012-dec 6-7</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of the 9th International Workshop on Spoken Language Translation: Papers</title>
        </titleInfo>
        <originInfo>
            <place>
                <placeTerm type="text">Hong Kong, Table of contents</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>We present a Monte Carlo model to simulate human judgments in machine translation evaluation campaigns, such as WMT or IWSLT. We use the model to compare different ranking methods and to give guidance on the number of judgments that need to be collected to obtain sufficiently significant distinctions between systems.</abstract>
    <identifier type="citekey">koehn-2012-simulating</identifier>
    <location>
        <url>https://aclanthology.org/2012.iwslt-papers.5</url>
    </location>
    <part>
        <date>2012-dec 6-7</date>
        <extent unit="page">
            <start>179</start>
            <end>184</end>
        </extent>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T Simulating human judgment in machine translation evaluation campaigns
%A Koehn, Philipp
%S Proceedings of the 9th International Workshop on Spoken Language Translation: Papers
%D 2012
%8 dec 6 7
%C Hong Kong, Table of contents
%F koehn-2012-simulating
%X We present a Monte Carlo model to simulate human judgments in machine translation evaluation campaigns, such as WMT or IWSLT. We use the model to compare different ranking methods and to give guidance on the number of judgments that need to be collected to obtain sufficiently significant distinctions between systems.
%U https://aclanthology.org/2012.iwslt-papers.5
%P 179-184

Markdown (Informal)

[Simulating human judgment in machine translation evaluation campaigns](https://aclanthology.org/2012.iwslt-papers.5) (Koehn, IWSLT 2012)

• Simulating human judgment in machine translation evaluation campaigns (Koehn, IWSLT 2012)

ACL

• Philipp Koehn. 2012. Simulating human judgment in machine translation evaluation campaigns. In Proceedings of the 9th International Workshop on Spoken Language Translation: Papers, pages 179–184, Hong Kong, Table of contents.