Gradient Descenders at DialectSentEval 2026: A Comparative Study of Pretrained Arabic Transformers for Multi-Dialect Sentiment Analysis

Tran Phuoc Thanh Nhan, Trong Thanh Le, Thìn Đặng Văn


Abstract
This paper presents the Gradient Descenders system for DialectSentEval Subtask 1 on multi-dialect Arabic sentiment analysis. Because general-purpose models often miss dialectal nuances, we compare three pretrained encoders with distinct linguistic orientations: MARBERTv2, DarijaBERT, and AraBERT. We formulate the task as three-class classification, employing a parameter-efficient head-only adaptation strategy that freezes encoder parameters. Our results show MARBERTv2 outperforms the others, achieving a Macro F1 of 80.11% and Accuracy of 81.90%, securing fifth place overall. These findings emphasize that backbone selection is critical; specifically, broad dialect-oriented pretraining yields the most transferable representations for multi-dialect generalization.
Anthology ID:
2026.arabicnlp-sharedtasks.178
Volume:
Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Muhammad Abdul-Mageed, Tamer Elsayed, Houda Bouamor, Samhaa El-Beltagy, Hend Al-Khalifa, Ahmed Abdelali, AbdelRahim Elmadany, Abdellah El Mekki, Kareem Darwish, Sakhar Alkhereyf, Hamzah Luqman, Salam Khalifa, Samar Magdy, Zaid Alyafeai, Injy Hamed, Wajdi Zaghouani, Imed Zitouni
Venue:
ArabicNLP
SIG:
SIGARAB
Publisher:
Association for Computational Linguistics
Note:
Pages:
1414–1418
Language:
URL:
https://aclanthology.org/2026.arabicnlp-sharedtasks.178/
DOI:
Bibkey:
Cite (ACL):
Tran Phuoc Thanh Nhan, Trong Thanh Le, and Thìn Đặng Văn. 2026. Gradient Descenders at DialectSentEval 2026: A Comparative Study of Pretrained Arabic Transformers for Multi-Dialect Sentiment Analysis. In Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks, pages 1414–1418, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Gradient Descenders at DialectSentEval 2026: A Comparative Study of Pretrained Arabic Transformers for Multi-Dialect Sentiment Analysis (Nhan et al., ArabicNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.arabicnlp-sharedtasks.178.pdf