Ahmed Younis at ArGuard Shared Tasks: Calibration Is Most of What You Tune: Decode-Time Structure and Threshold Transport for Arabic Harmful-Content Detection

Ahmed Younis


Abstract
We describe our systems for all four ArGuard 2026 subtasks: binary and fine-grained Arabic hateful-meme detection (A1/A2) and binary and granular harmful-prompt detection (B1/B2). Our systems are deliberately conventional (a LoRA-tuned Qwen3-VL-8B for memes, a nine-encoder ensemble for prompts) because our central finding is that most of the achievable headroom lay not in the model but in decode-time calibration: per-class thresholds refit under structural constraints, rank-based decoding against known or published class priors, and threshold transport under distribution shift. On subtask A2, our submissions rose from 0.248 to 0.419 macro-F1; roughly 0.15 of that gain came from decode-time changes against under 0.03 from model-side interventions, and a fixed-model ablation on the ensemble’s char-ngram member attributes +0.070 to the decode stack alone. On B1, recalibrating a single threshold recovered +0.16 macro-F1 after we detected that the blind test was rebalanced to approximately 49% unsafe against an 80% unsafe training prior. Our final systems ranked 1st on subtask A2 (macro-F1 0.4194; 0.3913 without per-class scoring feedback), 3rd on A1 (0.7889), 3rd on B2 (0.7695), and 7th on B1 (0.7552). We additionally report a benchmark audit conducted during participation: a sequential-id label leak in the Task B development release (macro-F1 1.000 from ids alone), identified before the test release, left unexploited, and absent from the re-indexed test files; latent taxonomy structure that contradicts the task description; and a quantified gap between development and test distributions.
Anthology ID:
2026.arabicnlp-sharedtasks.61
Volume:
Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Muhammad Abdul-Mageed, Tamer Elsayed, Houda Bouamor, Samhaa El-Beltagy, Hend Al-Khalifa, Ahmed Abdelali, AbdelRahim Elmadany, Abdellah El Mekki, Kareem Darwish, Sakhar Alkhereyf, Hamzah Luqman, Salam Khalifa, Samar Magdy, Zaid Alyafeai, Injy Hamed, Wajdi Zaghouani, Imed Zitouni
Venue:
ArabicNLP
SIG:
SIGARAB
Publisher:
Association for Computational Linguistics
Note:
Pages:
465–469
Language:
URL:
https://aclanthology.org/2026.arabicnlp-sharedtasks.61/
DOI:
Bibkey:
Cite (ACL):
Ahmed Younis. 2026. Ahmed Younis at ArGuard Shared Tasks: Calibration Is Most of What You Tune: Decode-Time Structure and Threshold Transport for Arabic Harmful-Content Detection. In Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks, pages 465–469, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Ahmed Younis at ArGuard Shared Tasks: Calibration Is Most of What You Tune: Decode-Time Structure and Threshold Transport for Arabic Harmful-Content Detection (Younis, ArabicNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.arabicnlp-sharedtasks.61.pdf