NU-SentEval at DialectSentEval Shared Task Subtask-1: Stacking Pre-trained Language Models with Focal Loss for Arabic Dialect Sentiment Analysis

Habiba Ayman Ahmed, Sara Lotfy, Ensaf H. Mohamed


Abstract
This paper presents the system developed by the NU-SentEval team for Subtask 1 (Sentiment Analysis in Dialectal Arabic) of the DialectSentEval 2026 Shared Task. Arabic dialect sentiment classification is challenging due to morphological complexity, orthographic variation across regional dialects, and class imbalances in user reviews. To address these challenges, we propose an ensembled architecture leveraging five diverse Pre-trained Language Models (PLMs): MARBERTv2, MARBERT, CAMeLBERT-DA, AraBERTv0.2-Twitter, and Twitter-XLM-RoBERTa. All models were fine-tuned using a customized Focal Loss objective combined with Label Smoothing to mitigate majority class bias and prevent overconfidence. Out-of-fold probability representations from individual models were aggregated through a Logistic Regression stacking meta-classifier (stacking_c1). On the official test set, our system achieved a Macro F1-score of 0.8141 and an Accuracy of 0.8343, demonstrating the effectiveness of combining specialized dialectal representations with loss regularization and meta-learning.
Anthology ID:
2026.arabicnlp-sharedtasks.186
Volume:
Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Muhammad Abdul-Mageed, Tamer Elsayed, Houda Bouamor, Samhaa El-Beltagy, Hend Al-Khalifa, Ahmed Abdelali, AbdelRahim Elmadany, Abdellah El Mekki, Kareem Darwish, Sakhar Alkhereyf, Hamzah Luqman, Salam Khalifa, Samar Magdy, Zaid Alyafeai, Injy Hamed, Wajdi Zaghouani, Imed Zitouni
Venue:
ArabicNLP
SIG:
SIGARAB
Publisher:
Association for Computational Linguistics
Note:
Pages:
1457–1461
Language:
URL:
https://aclanthology.org/2026.arabicnlp-sharedtasks.186/
DOI:
Bibkey:
Cite (ACL):
Habiba Ayman Ahmed, Sara Lotfy, and Ensaf H. Mohamed. 2026. NU-SentEval at DialectSentEval Shared Task Subtask-1: Stacking Pre-trained Language Models with Focal Loss for Arabic Dialect Sentiment Analysis. In Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks, pages 1457–1461, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
NU-SentEval at DialectSentEval Shared Task Subtask-1: Stacking Pre-trained Language Models with Focal Loss for Arabic Dialect Sentiment Analysis (Ahmed et al., ArabicNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.arabicnlp-sharedtasks.186.pdf