One Meaning, Many Romanizations: Selective Stability of Multilingual Representations under Informal Indic Romanization

Divyajot Singh


Abstract
Romanized writing is a common interface for speakers of Indic languages, but it is intrinsically many-to-one: several informal spellings express the same underlying utterance. Existing evaluations typically use one canonical transliteration and may therefore overestimate robustness. We introduce a 4,000-set convention-profile benchmark alongside native-script, human-Romanized, and human-attested equivalence views in Bengali, Hindi, Tamil, and Telugu. Across twelve pretrained and instruction-tuned models from three families, we measure token fragmentation, layer-wise representation dispersion, language-modeling loss, and cross-script retrieval instability. We formalize the target property asemphselective stability—equivalent spellings must contract while distinct meanings stay separated—operationalize it with a normalized within-equivalence distance, and test whether it predicts retrieval failure beyond token fertility. We find that cross-script invariance is aemphtransient phase in depth whose location is architecture-dependent, that representation distance predicts inconsistency better than fertility (ROC-AUC .774 vs. .634 on the small instruction model), and that a lightweight low-rank repair trained only on canonical and synthetic variants transfers to unseen natural spellings, held-out convention families, and unseen languages without improving Romanized reading comprehension. A per-language decomposition shows that the phase is also largely language-conditional: one Gemma 9B layer retrieves 90.4
Anthology ID:
2026.mrl-1.29
Volume:
Proceedings of the 6th Workshop on Multilingual Representation Learning (MRL 2026)
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
David Ifeoluwa Adelani, Jesujoba Alabi, Catherine Arnett, Tyler Chang, C.M. Downey, Omer Goldman, Senyu Li, Lester James Validad Miranda, Jirui Qi, David Stap, Genta Indra Winata, Xinyu Crystina Zhang
Venues:
MRL | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
366–376
Language:
URL:
https://aclanthology.org/2026.mrl-1.29/
DOI:
Bibkey:
Cite (ACL):
Divyajot Singh. 2026. One Meaning, Many Romanizations: Selective Stability of Multilingual Representations under Informal Indic Romanization. In Proceedings of the 6th Workshop on Multilingual Representation Learning (MRL 2026), pages 366–376, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
One Meaning, Many Romanizations: Selective Stability of Multilingual Representations under Informal Indic Romanization (Singh, MRL 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.mrl-1.29.pdf