Abdelrahman Sakr
Author directory2026
When Does Auxiliary Classification Help Regression in Practice? A Case Study in Arabic Dialectness Modeling
Abdelrahman Sakr | Marwan Torki | Nagwa El-Makky
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Abdelrahman Sakr | Marwan Torki | Nagwa El-Makky
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Estimating the Arabic Level of Dialectness (ALDi) is a continuous regression task that quantifies how much a sentence diverges from Modern Standard Arabic (MSA). While auxiliary classification is often used to support regression, its effectiveness depends critically on how the auxiliary task is designed. We conduct a systematic study of auxiliary classification for ALDi estimation, showing that naive auxiliary supervision can degrade regression performance under skewed target distributions. We identify two key factors that determine when auxiliary tasks become beneficial: the granularity of discretization and the choice of loss function. Specifically, 7-bin discretization combined with focal loss substantially improves performance. Our approach achieves an RMSE of 0.1275 on the NADI 2024 blind test set, outperforming previous systems by over 9%, and the same design transfers to English toxicity regression. Detailed error analysis reveals how auxiliary classification reshapes model behavior across the Arabic dialect spectrum. We release our code and model predictions to facilitate future research
SaAr-DF at ArA-DF 2026: When More Data Hurts — Diversity-Driven Ensembling for Arabic Speech Deepfake Detection
Abdelrahman Sakr | Amr Elzahaby
Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks
Abdelrahman Sakr | Amr Elzahaby
Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks
knights-ST at AraSeg Shared Task 2026: Cross-Family Ensembling with Task-Adaptive Pretraining for Arabic Sentence Segmentation
Abdelrahman Sakr | Marwan Torki
Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks
Abdelrahman Sakr | Marwan Torki
Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks
2024
AlexUNLP-STM at NADI 2024 shared task: Quantifying the Arabic Dialect Spectrum with Contrastive Learning, Weighted Sampling, and BERT-based Regression Ensemble
Abdelrahman Sakr | Marwan Torki | Nagwa El-Makky
Proceedings of the Second Arabic Natural Language Processing Conference
Abdelrahman Sakr | Marwan Torki | Nagwa El-Makky
Proceedings of the Second Arabic Natural Language Processing Conference
Recognizing the nuanced spectrum of dialectness in Arabic text poses a significant challenge for natural language processing (NLP) tasks. Traditional dialect identification (DI) methods treat the task as binary, overlooking the continuum of dialect variation present in Arabic speech and text. In this paper, we describe our submission to the NADI shared Task of ArabicNLP 2024. We participated in Subtask 2 - ALDi Estimation, which focuses on estimating the Arabic Level of Dialectness (ALDi) for Arabic text, indicating how much it deviates from Modern Standard Arabic (MSA) on a scale from 0 to 1, where 0 means MSA and 1 means high divergence from MSA. We explore diverse training approaches, including contrastive learning, applying a random weighted sampler along with fine-tuning a regression task based on the AraBERT model, after adding a linear and non-linear layer on top of its pooled output. Finally, performing a brute force ensemble strategy increases the performance of our system. Our proposed solution achieved a Root Mean Squared Error (RMSE) of 0.1406, ranking second on the leaderboard.