Digilians at ImageEval 2026 Shared Tasks: Modular Speech Parsing and Joint Multimodal Reasoning for Arabic Spoken VQA

Ahmed Eid Hassan, Nour Eldeen Hossam, Ahmed Hossam Rashad, Abdelrhman Mahmoud Fawzy, Mohammed Eid Abdelmeguid, Mohamed Hamdy Mohamed


Abstract
We describe the Digilians submission to Task 1a (Spoken Visual Question Answering, MSA track) of the ImageEval 2026 shared task (Abdaljalil et al., 2026). Our system splits the problem into independently cacheable stages: speech recognition, schema-constrained transcript parsing that recovers a question and three candidate answers from continuous Arabic speech, a conditional repair mechanism that escalates to a larger ASR model only for semantically degenerate parses, and a joint multiplechoice visual reasoning stage that evaluates all three candidates against the image simultaneously rather than scoring them independently. On the labeled development split (500 records, synthetic voice-cloned audio), our production configuration reaches 79.0% accuracy against a 39.8% official baseline, with nearly the entire gain over an earlier configuration coming from a single change to the answer-selection model. On the blind final test split (1,000 records, human-recorded audio), the same frozen configuration scores 65.6% accuracy / 57.4% balanced accuracy / 50.4% macro F1, a substantial drop we attribute to the dev-to-test recordingcondition shift and report as our most important finding. We also surface a caching-related reproducibility issue uncovered during development and discuss what both findings imply for pipelines built the same way.
Anthology ID:
2026.arabicnlp-sharedtasks.96
Volume:
Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Muhammad Abdul-Mageed, Tamer Elsayed, Houda Bouamor, Samhaa El-Beltagy, Hend Al-Khalifa, Ahmed Abdelali, AbdelRahim Elmadany, Abdellah El Mekki, Kareem Darwish, Sakhar Alkhereyf, Hamzah Luqman, Salam Khalifa, Samar Magdy, Zaid Alyafeai, Injy Hamed, Wajdi Zaghouani, Imed Zitouni
Venue:
ArabicNLP
SIG:
SIGARAB
Publisher:
Association for Computational Linguistics
Note:
Pages:
766–770
Language:
URL:
https://aclanthology.org/2026.arabicnlp-sharedtasks.96/
DOI:
Bibkey:
Cite (ACL):
Ahmed Eid Hassan, Nour Eldeen Hossam, Ahmed Hossam Rashad, Abdelrhman Mahmoud Fawzy, Mohammed Eid Abdelmeguid, and Mohamed Hamdy Mohamed. 2026. Digilians at ImageEval 2026 Shared Tasks: Modular Speech Parsing and Joint Multimodal Reasoning for Arabic Spoken VQA. In Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks, pages 766–770, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Digilians at ImageEval 2026 Shared Tasks: Modular Speech Parsing and Joint Multimodal Reasoning for Arabic Spoken VQA (Hassan et al., ArabicNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.arabicnlp-sharedtasks.96.pdf