Lingliang Zhang


2017

pdf bib
Robust Dictionary Lookup in Multiple Noisy Orthographies
Lingliang Zhang | Nizar Habash | Godfried Toussaint
Proceedings of the Third Arabic Natural Language Processing Workshop

We present the MultiScript Phonetic Search algorithm to address the problem of language learners looking up unfamiliar words that they heard. We apply it to Arabic dictionary lookup with noisy queries done using both the Arabic and Roman scripts. Our algorithm is based on a computational phonetic distance metric that can be optionally machine learned. To benchmark our performance, we created the ArabScribe dataset, containing 10,000 noisy transcriptions of random Arabic dictionary words. Our algorithm outperforms Google Translate’s “did you mean” feature, as well as the Yamli smart Arabic keyboard.