MT evaluation: old, new, and recycled

John White


Abstract
The tutorial addresses the issues peculiar to machine translation evaluation, namely the difficulty in determining what constitutes correct translation, and which types of evaluation are the most meaningful for evaluation "consumers." The tutorial is structured around evaluation methods designed for particular purposes: types of MT design, stages in the development lifecycle, and intended end-use of a system that includes MT. It will provide an overview of the issues and classic approaches to MT evaluation. The traditional processes, such as those outlined in the ALPAC report, will be examined for their value historically and in terms of today's environments. The tutorial also provides an insight into the latest evaluation techniques, designed to capture the value of MT systems in the context of current and future automated text handling processes.
Anthology ID:
1997.mtsummit-tutorials.3
Volume:
Proceedings of Machine Translation Summit VI: Tutorials
Month:
October 29 – November 1
Year:
1997
Address:
San Diego, California
Editors:
Virginia Teller, Beth Sundheim
Venue:
MTSummit
SIG:
Publisher:
Note:
Pages:
Language:
URL:
https://aclanthology.org/1997.mtsummit-tutorials.3
DOI:
Bibkey:
Cite (ACL):
John White. 1997. MT evaluation: old, new, and recycled. In Proceedings of Machine Translation Summit VI: Tutorials, San Diego, California.
Cite (Informal):
MT evaluation: old, new, and recycled (White, MTSummit 1997)
Copy Citation: