Axiom at AraSeg Shared Task 2026: A Regularized Dual-Model Ensemble with Domain-Adaptive Pretraining for Arabic Sentence Segmentation

Md. Ajwad Hossain


Abstract
Identifying sentence boundaries in Arabic text is a challenging token classification task due to extreme dialectal variations, the absence of rigid punctuation rules, and document lengths that frequently exceed the capacity of standard transformer models. In this paper, we describe Team Axiom’s submission to the Paragraph-Aware Open track of the AraSeg Shared Task 2026. We propose a highly regularized, dual-model ensemble combining MARBERTv2 and CAMeLBERT-MSA. To address the challenge of excessively long documents, we employ a sliding-window tokenization strategy. Furthermore, we adapt our base models to the task corpus using Domain-Adaptive Pretraining (DAPT). Our final system achieved a Macro-F1 score of 90.2% (Precision: 91.9%, Recall: 89.5%), securing 7th place in the shared task.
Anthology ID:
2026.arabicnlp-sharedtasks.113
Volume:
Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Muhammad Abdul-Mageed, Tamer Elsayed, Houda Bouamor, Samhaa El-Beltagy, Hend Al-Khalifa, Ahmed Abdelali, AbdelRahim Elmadany, Abdellah El Mekki, Kareem Darwish, Sakhar Alkhereyf, Hamzah Luqman, Salam Khalifa, Samar Magdy, Zaid Alyafeai, Injy Hamed, Wajdi Zaghouani, Imed Zitouni
Venue:
ArabicNLP
SIG:
SIGARAB
Publisher:
Association for Computational Linguistics
Note:
Pages:
922–926
Language:
URL:
https://aclanthology.org/2026.arabicnlp-sharedtasks.113/
DOI:
Bibkey:
Cite (ACL):
Md. Ajwad Hossain. 2026. Axiom at AraSeg Shared Task 2026: A Regularized Dual-Model Ensemble with Domain-Adaptive Pretraining for Arabic Sentence Segmentation. In Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks, pages 922–926, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Axiom at AraSeg Shared Task 2026: A Regularized Dual-Model Ensemble with Domain-Adaptive Pretraining for Arabic Sentence Segmentation (Hossain, ArabicNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.arabicnlp-sharedtasks.113.pdf