Align Me: A framework to generate Parallel Corpus Using OCRs and Bilingual Dictionaries

Priyam Bakliwal, Devadath V V, C V Jawahar


Abstract
Multilingual language processing tasks like statistical machine translation and cross language information retrieval rely mainly on availability of accurate parallel corpora. Manual construction of such corpus can be extremely expensive and time consuming. In this paper we present a simple yet efficient method to generate huge amount of reasonably accurate parallel corpus with minimal user efforts. We utilize the availability of large number of English books and their corresponding translations in other languages to build parallel corpus. Optical Character Recognizing systems are used to digitize such books. We propose a robust dictionary based parallel corpus generation system for alignment of multilingual text at different levels of granularity (sentence, paragraphs, etc). We show the performance of our proposed method on a manually aligned dataset of 300 Hindi-English sentences and 100 English-Malayalam sentences.
Anthology ID:
W16-3719
Volume:
Proceedings of the 6th Workshop on South and Southeast Asian Natural Language Processing (WSSANLP2016)
Month:
December
Year:
2016
Address:
Osaka, Japan
Venues:
WS | WSSANLP
SIG:
Publisher:
The COLING 2016 Organizing Committee
Note:
Pages:
183–187
Language:
URL:
https://aclanthology.org/W16-3719
DOI:
Bibkey:
Cite (ACL):
Priyam Bakliwal, Devadath V V, and C V Jawahar. 2016. Align Me: A framework to generate Parallel Corpus Using OCRs and Bilingual Dictionaries. In Proceedings of the 6th Workshop on South and Southeast Asian Natural Language Processing (WSSANLP2016), pages 183–187, Osaka, Japan. The COLING 2016 Organizing Committee.
Cite (Informal):
Align Me: A framework to generate Parallel Corpus Using OCRs and Bilingual Dictionaries (Bakliwal et al., 2016)
Copy Citation:
PDF:
https://aclanthology.org/W16-3719.pdf