Semi-automatic evaluation of the grammatical coverage of machine translation systems

A. Guessoum, R. Zantout


Abstract
In this paper we present a methodology for automating the evaluation of the grammatical coverage of machine translation (MT) systems. The methodology is based on the importance of unfolded grammatical structures, which represent the most basic syntactic pattern for a sentence in a given language. A database of unfolded grammatical structures is built to evaluate the parser of any NLP or MT system. The evaluation results in an overall measure called the grammatical coverage. The results of implementing the above approach on three English-to-Arabic commercial MT systems are presented.
Anthology ID:
2001.mtsummit-papers.25
Volume:
Proceedings of Machine Translation Summit VIII
Month:
September 18-22
Year:
2001
Address:
Santiago de Compostela, Spain
Editor:
Bente Maegaard
Venue:
MTSummit
SIG:
Publisher:
Note:
Pages:
Language:
URL:
https://aclanthology.org/2001.mtsummit-papers.25
DOI:
Bibkey:
Cite (ACL):
A. Guessoum and R. Zantout. 2001. Semi-automatic evaluation of the grammatical coverage of machine translation systems. In Proceedings of Machine Translation Summit VIII, Santiago de Compostela, Spain.
Cite (Informal):
Semi-automatic evaluation of the grammatical coverage of machine translation systems (Guessoum & Zantout, MTSummit 2001)
Copy Citation:
PDF:
https://aclanthology.org/2001.mtsummit-papers.25.pdf