TRANSLIT: A Large-scale Name Transliteration Resource

Fernando Benites, Gilbert François Duivesteijn, Pius von Däniken, Mark Cieliebak


Abstract
Transliteration is the process of expressing a proper name from a source language in the characters of a target language (e.g. from Cyrillic to Latin characters). We present TRANSLIT, a large-scale corpus with approx. 1.6 million entries in more than 180 languages with about 3 million variations of person and geolocation names. The corpus is based on various public data sources, which have been transformed into a unified format to simplify their usage, plus a newly compiled dataset from Wikipedia. In addition, we apply several machine learning methods to establish baselines for automatically detecting transliterated names in various languages. Our best systems achieve an accuracy of 92% on identification of transliterated pairs.
Anthology ID:
2020.lrec-1.399
Volume:
Proceedings of the 12th Language Resources and Evaluation Conference
Month:
May
Year:
2020
Address:
Marseille, France
Venue:
LREC
SIG:
Publisher:
European Language Resources Association
Note:
Pages:
3265–3271
Language:
English
URL:
https://aclanthology.org/2020.lrec-1.399
DOI:
Bibkey:
Cite (ACL):
Fernando Benites, Gilbert François Duivesteijn, Pius von Däniken, and Mark Cieliebak. 2020. TRANSLIT: A Large-scale Name Transliteration Resource. In Proceedings of the 12th Language Resources and Evaluation Conference, pages 3265–3271, Marseille, France. European Language Resources Association.
Cite (Informal):
TRANSLIT: A Large-scale Name Transliteration Resource (Benites et al., LREC 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.lrec-1.399.pdf