LSI at BAREC Shared Task 2026: A Controlled Study of Training Convergence, Heuristics, and Ensembles for Arabic Sentence-Level Readability

Sahara H. Al-Madi


Abstract
We present the Linguistic Security Institute (LSI) submission to the BAREC Shared Task 2026 (Task 1): predicting Arabic sentence readability on a 19-level ordinal scale. Our approach uses a logit-level ensemble of three Arabic pre-trained language models, with CAMeLBERT trained using an ordinal Earth Mover’s Distance loss and augmented by six SAMER Lexicon difficulty features. Controlled comparisons show that surface heuristics improve undertrained baselines but degrade converged models, and retrieval-augmented in-context learning yields no gains in this fine-grained setting. Our final ensemble achieves 81.7 QWK, ranking 1st among Constrained-track system submissions and 3rd among Open-track system submissions.
Anthology ID:
2026.arabicnlp-sharedtasks.25
Volume:
Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Muhammad Abdul-Mageed, Tamer Elsayed, Houda Bouamor, Samhaa El-Beltagy, Hend Al-Khalifa, Ahmed Abdelali, AbdelRahim Elmadany, Abdellah El Mekki, Kareem Darwish, Sakhar Alkhereyf, Hamzah Luqman, Salam Khalifa, Samar Magdy, Zaid Alyafeai, Injy Hamed, Wajdi Zaghouani, Imed Zitouni
Venue:
ArabicNLP
SIG:
SIGARAB
Publisher:
Association for Computational Linguistics
Note:
Pages:
219–224
Language:
URL:
https://aclanthology.org/2026.arabicnlp-sharedtasks.25/
DOI:
Bibkey:
Cite (ACL):
Sahara H. Al-Madi. 2026. LSI at BAREC Shared Task 2026: A Controlled Study of Training Convergence, Heuristics, and Ensembles for Arabic Sentence-Level Readability. In Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks, pages 219–224, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
LSI at BAREC Shared Task 2026: A Controlled Study of Training Convergence, Heuristics, and Ensembles for Arabic Sentence-Level Readability (Al-Madi, ArabicNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.arabicnlp-sharedtasks.25.pdf