CompLing at ArGuard Shared Tasks: Dialect-Aware Sparse Fusion for Arabic Prompt Safety Classification

Hamid T. Ogunlenu, Olaronke Oluwayemisi Adebanji, Emmanuel O. Ilesanmi, Olumide Ebenezer Ojo, Hiram Calvo, Grigori Sidorov


Abstract
We present our approach in this submission for ArGuard 2026 Subtask B1, which classifies Arabic prompts directed at large language models as Safe or Unsafe. Our system combines four sparse TF-IDF feature representations with dialect indicators and surface-level features. We trained logistic regression and Naive-Bayes SVM (NBSVM) classifiers and combined their predictions using late fusion. The system achieved a Macro-F1 score of 0.94 and an accuracy of 0.96 on the development set. On the test set, our submission achieved 0.79 accuracy, 0.85 macro precision, 0.71 macro recall, and 0.72 Macro-F1.
Anthology ID:
2026.arabicnlp-sharedtasks.54
Volume:
Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Muhammad Abdul-Mageed, Tamer Elsayed, Houda Bouamor, Samhaa El-Beltagy, Hend Al-Khalifa, Ahmed Abdelali, AbdelRahim Elmadany, Abdellah El Mekki, Kareem Darwish, Sakhar Alkhereyf, Hamzah Luqman, Salam Khalifa, Samar Magdy, Zaid Alyafeai, Injy Hamed, Wajdi Zaghouani, Imed Zitouni
Venue:
ArabicNLP
SIG:
SIGARAB
Publisher:
Association for Computational Linguistics
Note:
Pages:
426–431
Language:
URL:
https://aclanthology.org/2026.arabicnlp-sharedtasks.54/
DOI:
Bibkey:
Cite (ACL):
Hamid T. Ogunlenu, Olaronke Oluwayemisi Adebanji, Emmanuel O. Ilesanmi, Olumide Ebenezer Ojo, Hiram Calvo, and Grigori Sidorov. 2026. CompLing at ArGuard Shared Tasks: Dialect-Aware Sparse Fusion for Arabic Prompt Safety Classification. In Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks, pages 426–431, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
CompLing at ArGuard Shared Tasks: Dialect-Aware Sparse Fusion for Arabic Prompt Safety Classification (Ogunlenu et al., ArabicNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.arabicnlp-sharedtasks.54.pdf