Northwestern 2 at BAREC Shared Task 2026: CAMeLBERT-Mix for Fine-Grained Arabic Readability Assessment

Eman Sedqy Shlkamy, Wajdi Zaghouani


Abstract
This paper presents the Northwestern University in Qatar (NU-Q) submission to Task 1 of the BAREC Shared Task 2026 on fine-grained Arabic readability assessment. The task requires predicting the readability level of Arabic sentences across 19 ordered readability levels. Our system fine-tunes CAMeLBERT-Mix as a 19-class classifier using the official BAREC training data and cross-entropy optimization. We evaluate the proposed system using Quadratic Weighted Kappa (QWK), the official shared-task evaluation metric, together with classification accuracy. Our submitted system achieves a validation QWK of 0.7393 and an accuracy of 45.96%, indicating that pretrained Arabic language models provide a strong baseline for fine-grained Arabic readability assessment.
Anthology ID:
2026.arabicnlp-sharedtasks.19
Volume:
Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Muhammad Abdul-Mageed, Tamer Elsayed, Houda Bouamor, Samhaa El-Beltagy, Hend Al-Khalifa, Ahmed Abdelali, AbdelRahim Elmadany, Abdellah El Mekki, Kareem Darwish, Sakhar Alkhereyf, Hamzah Luqman, Salam Khalifa, Samar Magdy, Zaid Alyafeai, Injy Hamed, Wajdi Zaghouani, Imed Zitouni
Venue:
ArabicNLP
SIG:
SIGARAB
Publisher:
Association for Computational Linguistics
Note:
Pages:
175–178
Language:
URL:
https://aclanthology.org/2026.arabicnlp-sharedtasks.19/
DOI:
Bibkey:
Cite (ACL):
Eman Sedqy Shlkamy and Wajdi Zaghouani. 2026. Northwestern 2 at BAREC Shared Task 2026: CAMeLBERT-Mix for Fine-Grained Arabic Readability Assessment. In Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks, pages 175–178, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Northwestern 2 at BAREC Shared Task 2026: CAMeLBERT-Mix for Fine-Grained Arabic Readability Assessment (Shlkamy & Zaghouani, ArabicNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.arabicnlp-sharedtasks.19.pdf