AraGenre 2026: A Hierarchical Definition-Guided Arabic Genre Classification Shared Task

Mo El-Haj, Saad Ezzini, Shadi Abudalfa, Mustafa Jarrar, Nguyen Minh Chi, Quan Minh Nguyen


Abstract
AraGenre 2026 is a shared task on hierarchical, definition-guided Arabic genre classification under limited supervision and substantial distribution shift. Systems assign each text a broad label and a specific label using an inventory of six broad branches and 74 defined final genres. The final benchmark contains 27,972 source-derived Arabic segments, spanning Modern Standard Arabic, Classical Arabic, and dialectal material, while the released labelled examples are small and primarily synthetic. Final specific classes are absent from the released labelled data, but their English names and definitions are provided. The task received 46 registrations and 373 submissions, with 17 ranked final entries and 11 system description papers. Thaka achieved the highest official Hierarchical Macro F1 at 73.52, followed by HP at 71.69 and NAMAA-1 at 70.13. Broad classification was consistently stronger than specific classification. The documented systems frequently combine label semantics with multilingual retrieval, LLM judging, pseudo-labelling, reranking, or calibration. We clarify the resource-driven taxonomy and inherited gold labels, distinguish combined distribution shift from isolated unseen-label effects, and provide systematic validation of the final evaluation data.
Anthology ID:
2026.arabicnlp-sharedtasks.27
Volume:
Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Muhammad Abdul-Mageed, Tamer Elsayed, Houda Bouamor, Samhaa El-Beltagy, Hend Al-Khalifa, Ahmed Abdelali, AbdelRahim Elmadany, Abdellah El Mekki, Kareem Darwish, Sakhar Alkhereyf, Hamzah Luqman, Salam Khalifa, Samar Magdy, Zaid Alyafeai, Injy Hamed, Wajdi Zaghouani, Imed Zitouni
Venue:
ArabicNLP
SIG:
SIGARAB
Publisher:
Association for Computational Linguistics
Note:
Pages:
231–245
Language:
URL:
https://aclanthology.org/2026.arabicnlp-sharedtasks.27/
DOI:
Bibkey:
Cite (ACL):
Mo El-Haj, Saad Ezzini, Shadi Abudalfa, Mustafa Jarrar, Nguyen Minh Chi, and Quan Minh Nguyen. 2026. AraGenre 2026: A Hierarchical Definition-Guided Arabic Genre Classification Shared Task. In Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks, pages 231–245, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
AraGenre 2026: A Hierarchical Definition-Guided Arabic Genre Classification Shared Task (El-Haj et al., ArabicNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.arabicnlp-sharedtasks.27.pdf