Arabic-Centric Preference Optimization for Efficient Dialect-Sensitive Machine Translation: A Seq2Seq Approach

Abdelrahman Hisham, Malak Fathallah, Ayman Khalafallah


Abstract
Arabic machine translation remains challenging because Modern Standard Arabic and dialectal varieties such as Egyptian Colloquial Arabic differ substantially in morphology, lexical choice, register, and everyday usage. We introduce a compact Arabic-centric encoder–decoder machine translation model designed to strengthen translation involving Modern Standard Arabic and Egyptian Arabic while preserving multilingual translation ability. We pretrain from scratch with multilingual Seq2Seq training and contrastive cross-lingual alignment, using an Arabic-centered data mixture covering Arabic, English, Egyptian Arabic, and 111 additional languages. We further apply Direct Preference Optimization (DPO) for our Seq2Seq model using grounded preference pairs targeting Arabic-specific translation errors, including literal translation, register mismatch, lexical ambiguity, domain terminology, and dialectal naturalness. We evaluate our model on FLORES, WMT24++, and NTREX using spBLEU. Results show that our model remains competitive with substantially larger LLM baselines and achieves its clearest gains on Arabic-centered directions, especially Egyptian Arabic. DPO improves FLORES translation into English by approximately +2 spBLEU for Egyptian Arabic and +2 spBLEU for Modern Standard Arabic. Our findings support targeted Arabic-centric Seq2Seq modeling as an efficient path for dialect-sensitive machine translation.
Anthology ID:
2026.arabicnlp-main.25
Volume:
Proceedings of The Fourth Arabic Natural Language Processing Conference
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Muhammad Abdul-Mageed, Tamer Elsayed, Houda Bouamor, Samhaa El-Beltagy, Hend Al-Khalifa, Ahmed Abdelali, AbdelRahim Elmadany, Abdellah El Mekki, Kareem Darwish, Sakhar Alkhereyf, Hamzah Luqman, Salam Khalifa, Samar Magdy, Zaid Alyafeai, Injy Hamed, Wajdi Zaghouani, Imed Zitouni
Venue:
ArabicNLP
SIG:
SIGARAB
Publisher:
Association for Computational Linguistics
Note:
Pages:
356–372
Language:
URL:
https://aclanthology.org/2026.arabicnlp-main.25/
DOI:
Bibkey:
Cite (ACL):
Abdelrahman Hisham, Malak Fathallah, and Ayman Khalafallah. 2026. Arabic-Centric Preference Optimization for Efficient Dialect-Sensitive Machine Translation: A Seq2Seq Approach. In Proceedings of The Fourth Arabic Natural Language Processing Conference, pages 356–372, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Arabic-Centric Preference Optimization for Efficient Dialect-Sensitive Machine Translation: A Seq2Seq Approach (Hisham et al., ArabicNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.arabicnlp-main.25.pdf