faisalm93 at DialectSentEval 2026: A Five-Fold MARBERTv2 Ensemble for Arabic Dialect Sentiment Analysis

Faisal Muhammad Adam


Abstract
We describe our submission to DialectSentEval 2026 Subtask 1, a three-class sentiment task covering Moroccan, Egyptian, Lebanese, Jordanian, and Saudi Arabic. Our system fine-tunes MARBERTv2 in five stratified folds and averages their test probabilities. Using raw text without explicit dialect conditioning or external task-specific data, the official submission obtained 0.7939 macro-F1, 0.8152 accuracy, 0.7917 macro precision, and 0.7987 macro recall, ranking eighth among twelve systems in the supplied snapshot. Separately, a post-submission character 3-5-gram diagnostic falls from 0.9157 OOF macro-F1 with row-stratified folds to 0.7520 when repeated ID-label groups and normalized duplicates are kept together. This result establishes dataset-level split sensitivity; it does not quantify the effect on MARBERTv2. We document the submitted configuration, a group-aware diagnostic protocol, and the experiments still needed to isolate the effects of strict splitting and ensembling on the transformer system.
Anthology ID:
2026.arabicnlp-sharedtasks.183
Volume:
Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Muhammad Abdul-Mageed, Tamer Elsayed, Houda Bouamor, Samhaa El-Beltagy, Hend Al-Khalifa, Ahmed Abdelali, AbdelRahim Elmadany, Abdellah El Mekki, Kareem Darwish, Sakhar Alkhereyf, Hamzah Luqman, Salam Khalifa, Samar Magdy, Zaid Alyafeai, Injy Hamed, Wajdi Zaghouani, Imed Zitouni
Venue:
ArabicNLP
SIG:
SIGARAB
Publisher:
Association for Computational Linguistics
Note:
Pages:
1441–1445
Language:
URL:
https://aclanthology.org/2026.arabicnlp-sharedtasks.183/
DOI:
Bibkey:
Cite (ACL):
Faisal Muhammad Adam. 2026. faisalm93 at DialectSentEval 2026: A Five-Fold MARBERTv2 Ensemble for Arabic Dialect Sentiment Analysis. In Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks, pages 1441–1445, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
faisalm93 at DialectSentEval 2026: A Five-Fold MARBERTv2 Ensemble for Arabic Dialect Sentiment Analysis (Adam, ArabicNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.arabicnlp-sharedtasks.183.pdf