KnowledgeGraphEval 2026: The First Shared Task on Arabic Knowledge Graphs

Alaa Aljabari, Nagham Hamad, Abdellah El Mekki, Muhammad Abdul-Mageed, Imed Zitouni, Sanjay Chawla, Mustafa Jarrar


Abstract
We present KnowledgeGraphEval 2026, the first Arabic shared task dedicated to knowledge graph (KG) construction from text. The task focuses on extracting named entities and semantic relations from Arabic text to build structured, machine-readable knowledge representations. It includes two subtasks: (i) AdaptNER, which evaluates cross-domain named entity recognition (NER), and (ii) Relation Extraction (RE), which predicts semantic relations between predefined entity pairs. For AdaptNER, we release KONOOZ MSA, an Arabic NER benchmark annotated with 21 entity types across 10 domains. For RE, we release WojoodRelations, an Arabic RE dataset annotated with 40 relation types. At test time, 14 teams participated, of which 13 submitted system description papers, and one RE paper was subsequently rejected. The best systems achieve F1 scores of 76% and 96% on AdaptNER and RE, respectively. Results show that cross-domain NER remains challenging, while RE systems continue to face difficulties with rare and semantically confusable relations. We release the datasets, baselines, and evaluation tools for reproducible research in Arabic information extraction and KG construction.
Anthology ID:
2026.arabicnlp-sharedtasks.148
Volume:
Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Muhammad Abdul-Mageed, Tamer Elsayed, Houda Bouamor, Samhaa El-Beltagy, Hend Al-Khalifa, Ahmed Abdelali, AbdelRahim Elmadany, Abdellah El Mekki, Kareem Darwish, Sakhar Alkhereyf, Hamzah Luqman, Salam Khalifa, Samar Magdy, Zaid Alyafeai, Injy Hamed, Wajdi Zaghouani, Imed Zitouni
Venue:
ArabicNLP
SIG:
SIGARAB
Publisher:
Association for Computational Linguistics
Note:
Pages:
1182–1194
Language:
URL:
https://aclanthology.org/2026.arabicnlp-sharedtasks.148/
DOI:
Bibkey:
Cite (ACL):
Alaa Aljabari, Nagham Hamad, Abdellah El Mekki, Muhammad Abdul-Mageed, Imed Zitouni, Sanjay Chawla, and Mustafa Jarrar. 2026. KnowledgeGraphEval 2026: The First Shared Task on Arabic Knowledge Graphs. In Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks, pages 1182–1194, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
KnowledgeGraphEval 2026: The First Shared Task on Arabic Knowledge Graphs (Aljabari et al., ArabicNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.arabicnlp-sharedtasks.148.pdf