Rabee Al-Qasem at AraGenre 2026: Conformer Based Hierarchical Classifier for Arabic Genres

Rabee Al-Qasem


Abstract
This paper presents the first investigation into the performance of the Conformer architecture for hierarchical text classification, specifically applied to predicting two-level Arabic text genres. The proposed system combines multilingual sentence embeddings, target label definition representations, a Conformer projection module, an auxiliary broad-genre classifier, synthetic data augmentation, and seed-based ensembling. Evaluated on the official shared task, the approach achieved a Hierarchical Macro-F1 of 0.4399, demonstrating strong high-level genre classification (Broad Macro-F1 of 0.6288) while highlighting ongoing challenges in distinguishing semantically close specific subcategories (Specific Macro-F1 of 0.2511).
Anthology ID:
2026.arabicnlp-sharedtasks.28
Volume:
Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Muhammad Abdul-Mageed, Tamer Elsayed, Houda Bouamor, Samhaa El-Beltagy, Hend Al-Khalifa, Ahmed Abdelali, AbdelRahim Elmadany, Abdellah El Mekki, Kareem Darwish, Sakhar Alkhereyf, Hamzah Luqman, Salam Khalifa, Samar Magdy, Zaid Alyafeai, Injy Hamed, Wajdi Zaghouani, Imed Zitouni
Venue:
ArabicNLP
SIG:
SIGARAB
Publisher:
Association for Computational Linguistics
Note:
Pages:
246–251
Language:
URL:
https://aclanthology.org/2026.arabicnlp-sharedtasks.28/
DOI:
Bibkey:
Cite (ACL):
Rabee Al-Qasem. 2026. Rabee Al-Qasem at AraGenre 2026: Conformer Based Hierarchical Classifier for Arabic Genres. In Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks, pages 246–251, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Rabee Al-Qasem at AraGenre 2026: Conformer Based Hierarchical Classifier for Arabic Genres (Al-Qasem, ArabicNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.arabicnlp-sharedtasks.28.pdf