Dynamos at ArGuard Shared Tasks: Multimodal Transformers and Selective Ensembling for Binary and Fine-Grained Arabic Hateful Meme and Harmful Prompt Detection

Sheikh Abdul Wahid, Muhammad Yamin, Ali Arshad


Abstract
For the ArGuard 2026 shared task on harmful content detection in Arabic memes (Task A) and LLM prompts (Task B), we fine-tune Arabic transformer encoders across all four subtasks. Memes additionally use a vision tower (ViT-B/16 for the binary subtask, CLIP ViT-L/14 for the fine-grained one) late-fused with MARBERTv2; ensembling choices and decision thresholds are tuned per subtask throughout. Two methodological choices account for much of our gains: selecting checkpoints by development macro-F1 rather than loss, and aligning the B2 training target with the evaluation distribution. Our largest single effect, however, was diagnostic. The B1 blind test set is approximately class-balanced while its training data is ~80/20, so our dev-tuned threshold collapsed macro-F1 from 0.9557 on dev to 0.6345 on test. We recovered the test class balance algebraically from the aggregate metrics the platform reported to all participants; re-thresholding the same saved probabilities, with no retraining, restored 0.8628. Because this uses only aggregate leaderboard feedback (within the task rules), the B1 figure is not directly comparable to teams that did not use the channel and is not a generalisation estimate. This correction is also not general: on the weaker multi-label classifier (A2), stronger prior matching reduced performance in every setting we tested, so matching the test prior is not necessarily F1-optimal. We additionally report a catalogue of quantified negative results, including external-data augmentation with AraSafe. Final test macro-F1: A1 0.7869, A2 0.3463, B1 0.8628, B2 0.7622.
Anthology ID:
2026.arabicnlp-sharedtasks.46
Volume:
Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Muhammad Abdul-Mageed, Tamer Elsayed, Houda Bouamor, Samhaa El-Beltagy, Hend Al-Khalifa, Ahmed Abdelali, AbdelRahim Elmadany, Abdellah El Mekki, Kareem Darwish, Sakhar Alkhereyf, Hamzah Luqman, Salam Khalifa, Samar Magdy, Zaid Alyafeai, Injy Hamed, Wajdi Zaghouani, Imed Zitouni
Venue:
ArabicNLP
SIG:
SIGARAB
Publisher:
Association for Computational Linguistics
Note:
Pages:
371–378
Language:
URL:
https://aclanthology.org/2026.arabicnlp-sharedtasks.46/
DOI:
Bibkey:
Cite (ACL):
Sheikh Abdul Wahid, Muhammad Yamin, and Ali Arshad. 2026. Dynamos at ArGuard Shared Tasks: Multimodal Transformers and Selective Ensembling for Binary and Fine-Grained Arabic Hateful Meme and Harmful Prompt Detection. In Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks, pages 371–378, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Dynamos at ArGuard Shared Tasks: Multimodal Transformers and Selective Ensembling for Binary and Fine-Grained Arabic Hateful Meme and Harmful Prompt Detection (Wahid et al., ArabicNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.arabicnlp-sharedtasks.46.pdf