BAREC-ST-2026: The Second Shared Task on Arabic Readability Assessment

Khalid N. Elmadani, Bashar Alhafni, Hanada Taha, Nizar Habash


Abstract
We present the results and findings of the BAREC Shared Task 2026, the second shared task on Arabic readability assessment, organized as part of the Fourth Arabic Natural Language Processing Conference (ArabicNLP 2026). The shared task focuses on automatic readability assessment using the BAREC Corpus, addressing fine-grained classification across 19 readability levels. It comprises two subtasks —sentence-level classification and document-level classification— and three tracks: (1) the Strict Track, which permits only the BAREC Corpus; (2) the Constrained Track, which permits the BAREC Corpus, the SAMER Corpus, and the SAMER Lexicon; and (3) the Open Track, which permits the use of any external resources. A total of 14 teams from 12 countries registered for the task, of which 10 submitted system description papers. All participating teams competed only in the sentence-level classification subtask. The top-performing system achieved a quadratic weighted kappa (QWK) of 85.3.
Anthology ID:
2026.arabicnlp-sharedtasks.16
Volume:
Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Muhammad Abdul-Mageed, Tamer Elsayed, Houda Bouamor, Samhaa El-Beltagy, Hend Al-Khalifa, Ahmed Abdelali, AbdelRahim Elmadany, Abdellah El Mekki, Kareem Darwish, Sakhar Alkhereyf, Hamzah Luqman, Salam Khalifa, Samar Magdy, Zaid Alyafeai, Injy Hamed, Wajdi Zaghouani, Imed Zitouni
Venue:
ArabicNLP
SIG:
SIGARAB
Publisher:
Association for Computational Linguistics
Note:
Pages:
148–159
Language:
URL:
https://aclanthology.org/2026.arabicnlp-sharedtasks.16/
DOI:
Bibkey:
Cite (ACL):
Khalid N. Elmadani, Bashar Alhafni, Hanada Taha, and Nizar Habash. 2026. BAREC-ST-2026: The Second Shared Task on Arabic Readability Assessment. In Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks, pages 148–159, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
BAREC-ST-2026: The Second Shared Task on Arabic Readability Assessment (Elmadani et al., ArabicNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.arabicnlp-sharedtasks.16.pdf