Study on evaluation of WWW MT systems

Shinichiro Miyazawa, Shoichi Yokoyama, Masaki Matsudaira, Akira Kumano, Shuji Kodama, Hideki Kashioka, Yoshiko Shirokizawa, Yasuo Nakajima


Abstract
Compared with off-line machine translation (MT). MT for the WWW has more evaluation factors such as translation accuracy of text, interpretation of HTML tags, consistency with various protocols and browsers, and translation speed for net surfing. Moreover, the speed of technical innovation and its practical application is fast, including the appearance of new protocols. Improvement of MT software for the WWW will enable the sharing of information from around the world and make a great deal of contribution to mankind. Despite the importance of general evaluation studies on MT software for the WWW. it appears that such studies have not yet been conducted. Since MT for the WWW will be a critical factor for future international communication, its study and evaluation is an important theme. This study aims at standardized evaluation of MT for the WWW. and suggests an evaluation method focusing on unique aspects of the WWW independent of text. This evaluation method has a wide range of aptitude without depending on specific languages. Twenty-four items specific to the WWW were actually evaluated with regard to six MT software for the WWW. This study clarified various issues which should be improved in the future regarding MT software for the WWW and issues on evaluation technology of MT on the Internet.
Anthology ID:
1999.mtsummit-1.43
Volume:
Proceedings of Machine Translation Summit VII
Month:
September 13-17
Year:
1999
Address:
Singapore, Singapore
Venue:
MTSummit
SIG:
Publisher:
Note:
Pages:
290–298
Language:
URL:
https://aclanthology.org/1999.mtsummit-1.43
DOI:
Bibkey:
Cite (ACL):
Shinichiro Miyazawa, Shoichi Yokoyama, Masaki Matsudaira, Akira Kumano, Shuji Kodama, Hideki Kashioka, Yoshiko Shirokizawa, and Yasuo Nakajima. 1999. Study on evaluation of WWW MT systems. In Proceedings of Machine Translation Summit VII, pages 290–298, Singapore, Singapore.
Cite (Informal):
Study on evaluation of WWW MT systems (Miyazawa et al., MTSummit 1999)
Copy Citation:
PDF:
https://aclanthology.org/1999.mtsummit-1.43.pdf