Axiom at DialectSentEval 2026: Dialect-Aware Ensembling of MARBERTv2 and AraBERTv2 for Arabic Sentiment Analysis

Md. Ajwad Hossain


Abstract
Sentiment analysis of regional Arabic dialects presents a formidable challenge due to severe orthographic variation, morphological complexity, and a scarcity of annotated resources. To tackle these linguistic hurdles within Subtask-1 of the DialectSentEval 2026 Shared Task, team Axiom proposes a heavily regularized, dialect-aware ensemble framework combining two domain-complementary language models: MARBERTv2 and AraBERTv2. Our pipeline incorporates preprocessed dialect tags appended directly to input sequences, Stochastic Weight Averaging (SWA) for flat-minima convergence, and simple probability averaging across model outputs. Empirical results on the hidden test set demonstrate the robustness of this approach, with our system securing 2nd place overall and achieving an official Macro F1-Score of 0.8211.
Anthology ID:
2026.arabicnlp-sharedtasks.179
Volume:
Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Muhammad Abdul-Mageed, Tamer Elsayed, Houda Bouamor, Samhaa El-Beltagy, Hend Al-Khalifa, Ahmed Abdelali, AbdelRahim Elmadany, Abdellah El Mekki, Kareem Darwish, Sakhar Alkhereyf, Hamzah Luqman, Salam Khalifa, Samar Magdy, Zaid Alyafeai, Injy Hamed, Wajdi Zaghouani, Imed Zitouni
Venue:
ArabicNLP
SIG:
SIGARAB
Publisher:
Association for Computational Linguistics
Note:
Pages:
1419–1425
Language:
URL:
https://aclanthology.org/2026.arabicnlp-sharedtasks.179/
DOI:
Bibkey:
Cite (ACL):
Md. Ajwad Hossain. 2026. Axiom at DialectSentEval 2026: Dialect-Aware Ensembling of MARBERTv2 and AraBERTv2 for Arabic Sentiment Analysis. In Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks, pages 1419–1425, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Axiom at DialectSentEval 2026: Dialect-Aware Ensembling of MARBERTv2 and AraBERTv2 for Arabic Sentiment Analysis (Hossain, ArabicNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.arabicnlp-sharedtasks.179.pdf