LingLab at ArGuard Shared Tasks: A Lightweight Hybrid Classifier for Arabic Harmful Prompt Detection

Olaronke Oluwayemisi Adebanji, Emmanuel O. Ilesanmi, Olumide Ebenezer Ojo, Hiram Calvo, Grigori Sidorov, Anna Feldman


Abstract
The classification of Arabic prompts as Safe or Unsafe is the focus of this submission to ArGuard 2026 Subtask B1. We developed a lightweight hybrid classifier that combines lexical and semantic information. The lexical branch uses normalized word-level and character-level features with a class-balanced LinearSVC classifier. The semantic branch uses frozen multilingual E5 embeddings with a class-balanced logistic regression classifier. We combined the outputs of both branches using late fusion. On the development set, LinearSVC achieved a Macro-F1 score of 0.93, while the frozen E5 branch achieved 0.88. The final hybrid system achieved a Macro-F1 score of 0.93. On the test set, the submitted system achieved 0.78 accuracy, 0.83 precision, 0.70 recall, and 0.72 Macro-F1.
Anthology ID:
2026.arabicnlp-sharedtasks.49
Volume:
Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Muhammad Abdul-Mageed, Tamer Elsayed, Houda Bouamor, Samhaa El-Beltagy, Hend Al-Khalifa, Ahmed Abdelali, AbdelRahim Elmadany, Abdellah El Mekki, Kareem Darwish, Sakhar Alkhereyf, Hamzah Luqman, Salam Khalifa, Samar Magdy, Zaid Alyafeai, Injy Hamed, Wajdi Zaghouani, Imed Zitouni
Venue:
ArabicNLP
SIG:
SIGARAB
Publisher:
Association for Computational Linguistics
Note:
Pages:
394–399
Language:
URL:
https://aclanthology.org/2026.arabicnlp-sharedtasks.49/
DOI:
Bibkey:
Cite (ACL):
Olaronke Oluwayemisi Adebanji, Emmanuel O. Ilesanmi, Olumide Ebenezer Ojo, Hiram Calvo, Grigori Sidorov, and Anna Feldman. 2026. LingLab at ArGuard Shared Tasks: A Lightweight Hybrid Classifier for Arabic Harmful Prompt Detection. In Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks, pages 394–399, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
LingLab at ArGuard Shared Tasks: A Lightweight Hybrid Classifier for Arabic Harmful Prompt Detection (Adebanji et al., ArabicNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.arabicnlp-sharedtasks.49.pdf