<?xml version="1.0" encoding="UTF-8"?>
<modsCollection xmlns="http://www.loc.gov/mods/v3">
<mods ID="sugaya-etal-2001-precise">
    <titleInfo>
        <title>Precise measurement method of a speech translation system’s capability with a paired comparison method between the system and humans</title>
    </titleInfo>
    <name type="personal">
        <namePart type="given">Fumiaki</namePart>
        <namePart type="family">Sugaya</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Keiji</namePart>
        <namePart type="family">Yasuda</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Toshiyuki</namePart>
        <namePart type="family">Takezawa</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <name type="personal">
        <namePart type="given">Seiichi</namePart>
        <namePart type="family">Yamamoto</namePart>
        <role>
            <roleTerm authority="marcrelator" type="text">author</roleTerm>
        </role>
    </name>
    <originInfo>
        <dateIssued>2001-sep 18-22</dateIssued>
    </originInfo>
    <typeOfResource>text</typeOfResource>
    <relatedItem type="host">
        <titleInfo>
            <title>Proceedings of Machine Translation Summit VIII</title>
        </titleInfo>
        <name type="personal">
            <namePart type="given">Bente</namePart>
            <namePart type="family">Maegaard</namePart>
            <role>
                <roleTerm authority="marcrelator" type="text">editor</roleTerm>
            </role>
        </name>
        <originInfo>
            <place>
                <placeTerm type="text">Santiago de Compostela, Spain</placeTerm>
            </place>
        </originInfo>
        <genre authority="marcgt">conference publication</genre>
    </relatedItem>
    <abstract>The main goal of the present paper is to propose new schemes for the overall evaluation of a speech translation system. These schemes are expected to support and improve the design of the target application system, and precisely determine its performance. Experiments are conducted on the Japanese-to-English speech translation system ATR-MATRIX, which was developed at ATR Interpreting Telecommunications Research Laboratories. In the proposed schemes, the system’s translations are compared with those of a native Japanese taking the Test of English for International Communication (TOEIC), which is used as a measure of one’s speech translation capability. Subjective and automatic comparisons are made and the results are compared. A regression analysis on the subjective results shows that the speech translation capability of ATR-MATRIX matches a Japanese person scoring around 500 on the TOEIC. The automatic comparisons also show promising results.</abstract>
    <identifier type="citekey">sugaya-etal-2001-precise</identifier>
    <location>
        <url>https://aclanthology.org/2001.mtsummit-papers.62</url>
    </location>
    <part>
        <date>2001-sep 18-22</date>
    </part>
</mods>
</modsCollection>

%0 Conference Proceedings
%T Precise measurement method of a speech translation system’s capability with a paired comparison method between the system and humans
%A Sugaya, Fumiaki
%A Yasuda, Keiji
%A Takezawa, Toshiyuki
%A Yamamoto, Seiichi
%Y Maegaard, Bente
%S Proceedings of Machine Translation Summit VIII
%D 2001
%8 sep 18 22
%C Santiago de Compostela, Spain
%F sugaya-etal-2001-precise
%X The main goal of the present paper is to propose new schemes for the overall evaluation of a speech translation system. These schemes are expected to support and improve the design of the target application system, and precisely determine its performance. Experiments are conducted on the Japanese-to-English speech translation system ATR-MATRIX, which was developed at ATR Interpreting Telecommunications Research Laboratories. In the proposed schemes, the system’s translations are compared with those of a native Japanese taking the Test of English for International Communication (TOEIC), which is used as a measure of one’s speech translation capability. Subjective and automatic comparisons are made and the results are compared. A regression analysis on the subjective results shows that the speech translation capability of ATR-MATRIX matches a Japanese person scoring around 500 on the TOEIC. The automatic comparisons also show promising results.
%U https://aclanthology.org/2001.mtsummit-papers.62

Markdown (Informal)

[Precise measurement method of a speech translation system’s capability with a paired comparison method between the system and humans](https://aclanthology.org/2001.mtsummit-papers.62) (Sugaya et al., MTSummit 2001)

• Precise measurement method of a speech translation system’s capability with a paired comparison method between the system and humans (Sugaya et al., MTSummit 2001)

ACL

• Fumiaki Sugaya, Keiji Yasuda, Toshiyuki Takezawa, and Seiichi Yamamoto. 2001. Precise measurement method of a speech translation system’s capability with a paired comparison method between the system and humans. In Proceedings of Machine Translation Summit VIII, Santiago de Compostela, Spain.