Maghi King
2008
Improving Contextual Quality Models for MT Evaluation Based on Evaluators’ Feedback
Paula Estrella | Andrei Popescu-Belis | Maghi King
Proceedings of the Sixth International Conference on Language Resources and Evaluation (LREC'08)
Paula Estrella | Andrei Popescu-Belis | Maghi King
Proceedings of the Sixth International Conference on Language Resources and Evaluation (LREC'08)
The Framework for the Evaluation for Machine Translation (FEMTI) contains guidelines for building a quality model that is used to evaluate MT systems in relation to the purpose and intended context of use of the systems. Contextual quality models can thus be constructed, but entering into FEMTI the knowledge required for this operation is a complex task. An experiment has been set up in order to transfer knowledge from MT evaluation experts into the FEMTI guidelines, by polling experts about the evaluation methods they would use in a particular context, then inferring from the results generic relations between characteristics of the context of use and quality characteristics. The results of this hands-on exercise, carried out as part of a conference tutorial, have served to refine FEMTIs generic contextual quality model and to obtain feedback on the FEMTI guidelines in general.
2007
Context-based evaluation of MT systems: principles and tools
Maghi King | Andrei Popescu-Belis | Paula Estrella
Proceedings of Machine Translation Summit XI: Tutorials
Maghi King | Andrei Popescu-Belis | Paula Estrella
Proceedings of Machine Translation Summit XI: Tutorials
A new method for the study of correlations between MT evaluation metrics
Paula Estrella | Andrei Popescu-Belis | Maghi King
Proceedings of the 11th Conference on Theoretical and Methodological Issues in Machine Translation of Natural Languages: Papers
Paula Estrella | Andrei Popescu-Belis | Maghi King
Proceedings of the 11th Conference on Theoretical and Methodological Issues in Machine Translation of Natural Languages: Papers
2003
Living up to standards
Maghi King
Proceedings of the EACL 2003 Workshop on Evaluation Initiatives in Natural Language Processing: are evaluation methods, metrics and resources reusable?
Maghi King
Proceedings of the EACL 2003 Workshop on Evaluation Initiatives in Natural Language Processing: are evaluation methods, metrics and resources reusable?
2001
Towards a two-stage taxonomy for machine translation evaluation
Andrei Popescu-Belis | Sandra Manzi | Maghi King
Workshop on MT Evaluation
Andrei Popescu-Belis | Sandra Manzi | Maghi King
Workshop on MT Evaluation
1998
Workflow, computer aids and organisational issues
Maghi King
Proceedings of the 1998 EAMT Workshop: Translation technology: integration in the workflow environment
Maghi King
Proceedings of the 1998 EAMT Workshop: Translation technology: integration in the workflow environment
1995
1994
The Role of MT Evaluation
Scott Bennett | George Doddington | Mary Flanagan | Laurie Gerber | Maghi King | Marjorie León | John White
Proceedings of the First Conference of the Association for Machine Translation in the Americas
Scott Bennett | George Doddington | Mary Flanagan | Laurie Gerber | Maghi King | Marjorie León | John White
Proceedings of the First Conference of the Association for Machine Translation in the Americas