Noisy Uyghur Text Normalization

Osman Tursun, Ruket Cakici


Abstract
Uyghur is the second largest and most actively used social media language in China. However, a non-negligible part of Uyghur text appearing in social media is unsystematically written with the Latin alphabet, and it continues to increase in size. Uyghur text in this format is incomprehensible and ambiguous even to native Uyghur speakers. In addition, Uyghur texts in this form lack the potential for any kind of advancement for the NLP tasks related to the Uyghur language. Restoring and preventing noisy Uyghur text written with unsystematic Latin alphabets will be essential to the protection of Uyghur language and improving the accuracy of Uyghur NLP tasks. To this purpose, in this work we propose and compare the noisy channel model and the neural encoder-decoder model as normalizing methods.
Anthology ID:
W17-4412
Volume:
Proceedings of the 3rd Workshop on Noisy User-generated Text
Month:
September
Year:
2017
Address:
Copenhagen, Denmark
Editors:
Leon Derczynski, Wei Xu, Alan Ritter, Tim Baldwin
Venue:
WNUT
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
85–93
Language:
URL:
https://aclanthology.org/W17-4412
DOI:
10.18653/v1/W17-4412
Bibkey:
Cite (ACL):
Osman Tursun and Ruket Cakici. 2017. Noisy Uyghur Text Normalization. In Proceedings of the 3rd Workshop on Noisy User-generated Text, pages 85–93, Copenhagen, Denmark. Association for Computational Linguistics.
Cite (Informal):
Noisy Uyghur Text Normalization (Tursun & Cakici, WNUT 2017)
Copy Citation:
PDF:
https://aclanthology.org/W17-4412.pdf