ANLP-UniSo at ArGuard 2026 Task A: Multimodal AraBERT–ResNet50 with Knowledge Graph Fusion for Arabic Hateful Meme Detection

Saoussen Ben Chaabane, Omar Trigui, Maher Jaoua


Abstract
Detecting hateful content in Arabic memes is challenging due to dialectal variation, sarcasm, cultural references, and the interplay between visual and textual signals. We participate in ArGuard 2026 Track A (Multimodal Hateful Meme Detection) with a multimodal architecture that fuses AraBERT textual representations, ResNet50 visual features, and a lightweight knowledge-graph (KG) ontology vector derived from domain-specific Arabicbinary keywords. The model jointly optimizes (Hateful / Not Hateful) and multi-label finegrained classification through a gated fusion layer with strong regularization (dropout 0.45, weight decay 0.05, label smoothing 0.1). Gradual unfreezing of AraBERT layers, weighted sampling, and Arabic-specific normalization further improve robustness. On the official development set the system reaches a binary macro-F1 of 0.710; on the blind test set it obtains binary macro-F1 0.717. We analyse the contribution of each modality and discuss remaining challenges of fine-grained multi-label prediction under severe class imbalance.
Anthology ID:
2026.arabicnlp-sharedtasks.58
Volume:
Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Muhammad Abdul-Mageed, Tamer Elsayed, Houda Bouamor, Samhaa El-Beltagy, Hend Al-Khalifa, Ahmed Abdelali, AbdelRahim Elmadany, Abdellah El Mekki, Kareem Darwish, Sakhar Alkhereyf, Hamzah Luqman, Salam Khalifa, Samar Magdy, Zaid Alyafeai, Injy Hamed, Wajdi Zaghouani, Imed Zitouni
Venue:
ArabicNLP
SIG:
SIGARAB
Publisher:
Association for Computational Linguistics
Note:
Pages:
448–452
Language:
URL:
https://aclanthology.org/2026.arabicnlp-sharedtasks.58/
DOI:
Bibkey:
Cite (ACL):
Saoussen Ben Chaabane, Omar Trigui, and Maher Jaoua. 2026. ANLP-UniSo at ArGuard 2026 Task A: Multimodal AraBERT–ResNet50 with Knowledge Graph Fusion for Arabic Hateful Meme Detection. In Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks, pages 448–452, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
ANLP-UniSo at ArGuard 2026 Task A: Multimodal AraBERT–ResNet50 with Knowledge Graph Fusion for Arabic Hateful Meme Detection (Ben Chaabane et al., ArabicNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.arabicnlp-sharedtasks.58.pdf