Context-aware Transliteration of Romanized South Asian Languages

Christo Kirov, Cibu Johny, Anna Katanova, Alexander Gutkin, Brian Roark


Abstract
While most transliteration research is focused on single tokens such as named entities—for example, transliteration of from the Gujarati script to the Latin script “Ahmedabad” footnoteThe most populous city in the Indian state of Gujarat. the informal romanization prevalent in South Asia and elsewhere often requires transliteration of full sentences. The lack of large parallel text collections of full sentence (as opposed to single word) transliterations necessitates incorporation of contextual information into transliteration via non-parallel resources, such as via mono-script text collections. In this article, we present a number of methods for improving transliteration in context for such a use scenario. Some of these methods in fact improve performance without making use of sentential context, allowing for better quantification of the degree to which contextual information in particular is responsible for system improvements. Our final systems, which ultimately rely upon ensembles including large pretrained language models fine-tuned on simulated parallel data, yield substantial improvements over the best previously reported results for full sentence transliteration from Latin to native script on all 12 languages in the Dakshina dataset (Roark et al. 2020), with an overall 3.3% absolute (18.6% relative) mean word-error rate reduction.
Anthology ID:
2024.cl-2.2
Volume:
Computational Linguistics, Volume 50, Issue 2 - June 2023
Month:
June
Year:
2024
Address:
Cambridge, MA
Venue:
CL
SIG:
Publisher:
MIT Press
Note:
Pages:
475–534
Language:
URL:
https://aclanthology.org/2024.cl-2.2
DOI:
10.1162/coli_a_00510
Bibkey:
Cite (ACL):
Christo Kirov, Cibu Johny, Anna Katanova, Alexander Gutkin, and Brian Roark. 2024. Context-aware Transliteration of Romanized South Asian Languages. Computational Linguistics, 50(2):475–534.
Cite (Informal):
Context-aware Transliteration of Romanized South Asian Languages (Kirov et al., CL 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.cl-2.2.pdf