Benchmarking Dialectal Arabic-Turkish Machine Translation

Hasan Alkheder, Houda Bouamor, Nizar Habash, Ahmet Zengin


Abstract
Due to the significant influx of Syrian refugees in Turkey in recent years, the Syrian Arabic dialect has become increasingly prevalent in certain regions of Turkey. Developing a machine translation system between Turkish and Syrian Arabic would be crucial in facilitating communication between the Turkish and Syrian communities in these regions, which can have a positive impact on various domains such as politics, trade, and humanitarian aid. Such a system would also contribute positively to the growing Arab-focused tourism industry in Turkey. In this paper, we present the first research effort exploring translation between Syrian Arabic and Turkish. We use a set of 2,000 parallel sentences from the MADAR corpus containing 25 different city dialects from different cities across the Arab world, in addition to Modern Standard Arabic (MSA), English, and French. Additionally, we explore the translation performance into Turkish from other Arabic dialects and compare the results to the performance achieved when translating from Syrian Arabic. We build our MADAR-Turk data set by manually translating the set of 2,000 sentences from the Damascus dialect of Syria to Turkish with the help of two native Arabic speakers from Syria who are also highly fluent in Turkish. We evaluate the quality of the translations and report the results achieved. We make this first-of-a-kind data set publicly available to support research in machine translation between these important but less studied language pairs.
Anthology ID:
2023.mtsummit-research.22
Volume:
Proceedings of Machine Translation Summit XIX, Vol. 1: Research Track
Month:
September
Year:
2023
Address:
Macau SAR, China
Editors:
Masao Utiyama, Rui Wang
Venue:
MTSummit
SIG:
Publisher:
Asia-Pacific Association for Machine Translation
Note:
Pages:
261–271
Language:
URL:
https://aclanthology.org/2023.mtsummit-research.22
DOI:
Bibkey:
Cite (ACL):
Hasan Alkheder, Houda Bouamor, Nizar Habash, and Ahmet Zengin. 2023. Benchmarking Dialectal Arabic-Turkish Machine Translation. In Proceedings of Machine Translation Summit XIX, Vol. 1: Research Track, pages 261–271, Macau SAR, China. Asia-Pacific Association for Machine Translation.
Cite (Informal):
Benchmarking Dialectal Arabic-Turkish Machine Translation (Alkheder et al., MTSummit 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.mtsummit-research.22.pdf