Masuzo Yanagida


2003

pdf bib
Applications of Automatic Evaluation Methods to Measuring a Capability of Speech Translation System
Keiji Yasuda | Fumiaki Sugaya | Toshiyuki Takezawa | Seiichi Yamamoto | Masuzo Yanagida
10th Conference of the European Chapter of the Association for Computational Linguistics

2002

pdf bib
Automatic machine translation selection scheme to output the best result
Keiji Yasuda | Fumiaki Sugaya | Toshiyuki Takezawa | Seiichi Yamamoto | Masuzo Yanagida
Proceedings of the Third International Conference on Language Resources and Evaluation (LREC’02)

2001

pdf bib
An automatic evaluation method of translation quality using translation answer candidates queried from a parallel corpus
Keiji Yasuda | Fumiaki Sugaya | Toshiyuki Takezawa | Seiichi Yamamoto | Masuzo Yanagida
Proceedings of Machine Translation Summit VIII

An automatic translation quality evaluation method is proposed. In the proposed method, a parallel corpus is used to query translation answer candidates. The translation output is evaluated by measuring the similarity between the translation output and translation answer candidates with DP matching. This method evaluates a language translation subsystem of the Japanese-to-English ATR-MATRIX speech translation system developed at ATR Interpreting Telecommunications Research Laboratories. Discriminant analysis is then carried out to examine the evaluation performance of the proposed method. Experimental results show the effectiveness of the proposed method. The discriminant ratio is 83.5% for 2-class discrimination between absolutely correct and less appropriate translations classified subjectively. Also discussed are issues of the proposed method when it is applied to speech translation systems which inevitably make recognition errors.