Sentiment Analysis on Arabic Dialects: A Multi-Dialect Benchmark

Abdusalam F. Ahmad Nwesri, Nabila Almabrouk S. Shinbir, Amani Bahlul Sharif


Abstract
This paper presents our contribution to the AHASIS Shared Task at RANLP 2025, which focuses on sentiment analysis for Arabic dialects. While sentiment analysis has seen considerable progress in Modern Standard Arabic (MSA), the diversity and complexity of Arabic dialects pose unique challenges that remain underexplored. We address this by fine-tuning six pre-trained language models, including AraBERT, MARBERTv2, QARiB, and DarijaBERT, on a sentiment-labeled dataset comprising hotel reviews written in Saudi and Moroccan (Darija) dialects. Our experiments evaluate the models’ performance on both combined and individual dialect datasets. MARBERTv2 achieved the highest performance with an F1-score of 79% on the test set, securing third place among 14 participants. We further analyze the effectiveness of each model across dialects, demonstrating the importance of dialect-aware pretraining for Arabic sentiment analysis. Our findings highlight the value of leveraging large pre-trained models tailored to dialectal Arabic for improved sentiment classification.
Anthology ID:
2025.ranlp-ahasis.13
Volume:
Proceedings of the Shared Task on Sentiment Analysis for Arabic Dialects
Month:
September
Year:
2025
Address:
Varna, Bulgaria
Editors:
Maram Alharbi, Salmane Chafik, Saad Ezzini, Ruslan Mitkov, Tharindu Ranasinghe, Hansi Hettiarachchi
Venues:
RANLP | WS
SIG:
Publisher:
INCOMA Ltd., Shoumen, Bulgaria
Note:
Pages:
86–91
Language:
URL:
https://aclanthology.org/2025.ranlp-ahasis.13/
DOI:
Bibkey:
Cite (ACL):
Abdusalam F. Ahmad Nwesri, Nabila Almabrouk S. Shinbir, and Amani Bahlul Sharif. 2025. Sentiment Analysis on Arabic Dialects: A Multi-Dialect Benchmark. In Proceedings of the Shared Task on Sentiment Analysis for Arabic Dialects, pages 86–91, Varna, Bulgaria. INCOMA Ltd., Shoumen, Bulgaria.
Cite (Informal):
Sentiment Analysis on Arabic Dialects: A Multi-Dialect Benchmark (Nwesri et al., RANLP 2025)
Copy Citation:
PDF:
https://aclanthology.org/2025.ranlp-ahasis.13.pdf