Overview of the IWSLT 2011 evaluation campaign

Marcello Federico, Luisa Bentivogli, Michael Paul, Sebastian Stüker


Abstract
We report here on the eighth Evaluation Campaign organized by the IWSLT workshop. This year, the IWSLT evaluation focused on the automatic translation of public talks and included tracks for speech recognition, speech translation, text translation, and system combination. Unlike previous years, all data supplied for the evaluation has been publicly released on the workshop website, and is at the disposal of researchers interested in working on our benchmarks and in comparing their results with those published at the workshop. This paper provides an overview of the IWSLT 2011 Evaluation Campaign, which includes: descriptions of the supplied data and evaluation specifications of each track, the list of participants specifying their submitted runs, a detailed description of the subjective evaluation carried out, the main findings of each exercise drawn from the results and the system descriptions prepared by the participants, and, finally, several detailed tables reporting all the evaluation results.
Anthology ID:
2011.iwslt-evaluation.1
Volume:
Proceedings of the 8th International Workshop on Spoken Language Translation: Evaluation Campaign
Month:
December 8-9
Year:
2011
Address:
San Francisco, California
Editors:
Marcello Federico, Mei-Yuh Hwang, Margit Rödder, Sebastian Stüker
Venue:
IWSLT
SIG:
SIGSLT
Publisher:
Note:
Pages:
11–27
Language:
URL:
https://aclanthology.org/2011.iwslt-evaluation.1
DOI:
Bibkey:
Cite (ACL):
Marcello Federico, Luisa Bentivogli, Michael Paul, and Sebastian Stüker. 2011. Overview of the IWSLT 2011 evaluation campaign. In Proceedings of the 8th International Workshop on Spoken Language Translation: Evaluation Campaign, pages 11–27, San Francisco, California.
Cite (Informal):
Overview of the IWSLT 2011 evaluation campaign (Federico et al., IWSLT 2011)
Copy Citation:
PDF:
https://aclanthology.org/2011.iwslt-evaluation.1.pdf