ArA-DF 2026: Findings of the First Shared Task on Arabic Speech Deepfake Detection

Vasista Sai Lodagala, Yassine El Kheir, Sara Althubaiti, Pedro Jose Moreno Mengibar, Ahmed Ali


Abstract
We present ArA-DF 2026, the first shared task for Arabic speech deepfake detection, held at ArabicNLP-2026. Unlike existing benchmarks that conflate all distribution shift into a single evaluation set, ArA-DF 2026 separates dialect generalization (Track 1: unseen Arabic dialects and speakers) from acoustic robustness (Track 2: codec compression, noise, reverberation, re-encoding). We release 43,500 labeled training utterances spanning MSA and regional dialects, plus blind evaluation sets of 144,210 (Track 1) and 127,746 (Track 2) utterances, ranking systems by EER. Fourteen teams competed on Track 1 and twelve on Track 2, with eight system description papers submitted. The best submissions cut EER from 14.54% to 0.87% (Track 1) and from 27.11% to 0.66% (Track 2). Across independent submissions, three findings recur: augmentation and data curation move performance far more than architecture; simpler pooling heads often outperform graph-attention back-ends once augmentation is applied; and external synthetic Arabic speech with mismatched generation artifacts hurts rather than helps. Residual errors concentrate on short utterances and on spoofed audio misclassified as bona fide.
Anthology ID:
2026.arabicnlp-sharedtasks.189
Volume:
Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Muhammad Abdul-Mageed, Tamer Elsayed, Houda Bouamor, Samhaa El-Beltagy, Hend Al-Khalifa, Ahmed Abdelali, AbdelRahim Elmadany, Abdellah El Mekki, Kareem Darwish, Sakhar Alkhereyf, Hamzah Luqman, Salam Khalifa, Samar Magdy, Zaid Alyafeai, Injy Hamed, Wajdi Zaghouani, Imed Zitouni
Venue:
ArabicNLP
SIG:
SIGARAB
Publisher:
Association for Computational Linguistics
Note:
Pages:
1473–1485
Language:
URL:
https://aclanthology.org/2026.arabicnlp-sharedtasks.189/
DOI:
Bibkey:
Cite (ACL):
Vasista Sai Lodagala, Yassine El Kheir, Sara Althubaiti, Pedro Jose Moreno Mengibar, and Ahmed Ali. 2026. ArA-DF 2026: Findings of the First Shared Task on Arabic Speech Deepfake Detection. In Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks, pages 1473–1485, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
ArA-DF 2026: Findings of the First Shared Task on Arabic Speech Deepfake Detection (Lodagala et al., ArabicNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.arabicnlp-sharedtasks.189.pdf