Beyond Orthography: Automatic Recovery of Short Vowels and Dialectal Sounds in Arabic

Yassine El Kheir, Hamdy Mubarak, Ahmed Ali, Shammur Chowdhury


Abstract
This paper presents a novel Dialectal Sound and Vowelization Recovery framework, designed to recognize borrowed and dialectal sounds within phonologically diverse and dialect-rich languages, that extends beyond its standard orthographic sound sets. The proposed framework utilized quantized sequence of input with(out) continuous pretrained self-supervised representation. We show the efficacy of the pipeline using limited data for Arabic, a dialect-rich language containing more than 22 major dialects. Phonetically correct transcribed speech resources for dialectal Arabic is scare. Therefore, we introduce ArabVoice15, a first of its kind, curated test set featuring 5 hours of dialectal speech across 15 Arab countries, with phonetically accurate transcriptions, including borrowed and dialect-specific sounds. We described in detail the annotation guideline along with the analysis of the dialectal confusion pairs. Our extensive evaluation includes both subjective – human perception tests and objective measures. Our empirical results, reported with three test sets, show that with only one and half hours of training data, our model improve character error rate by ≈7% in ArabVoice15 compared to the baseline.
Anthology ID:
2024.acl-long.711
Volume:
Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Month:
August
Year:
2024
Address:
Bangkok, Thailand
Editors:
Lun-Wei Ku, Andre Martins, Vivek Srikumar
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
13172–13184
Language:
URL:
https://aclanthology.org/2024.acl-long.711
DOI:
Bibkey:
Cite (ACL):
Yassine El Kheir, Hamdy Mubarak, Ahmed Ali, and Shammur Chowdhury. 2024. Beyond Orthography: Automatic Recovery of Short Vowels and Dialectal Sounds in Arabic. In Proceedings of the 62nd Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 13172–13184, Bangkok, Thailand. Association for Computational Linguistics.
Cite (Informal):
Beyond Orthography: Automatic Recovery of Short Vowels and Dialectal Sounds in Arabic (El Kheir et al., ACL 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.acl-long.711.pdf