Nile Nexus at ImageEval 2026 Shared Tasks: Single-Choice Reformulation and Confidence-Calibrated Refinement for Culturally Grounded Hallucination Detection

Sumaiya Zaman, Miftahul Jannat Rishta


Abstract
Visual hallucination detection in culturally grounded images has remained challenging due to fine-grained visual distinctions and knowledge-dependent statements. In the ImageEval2026 / ArabicNLP26 AynVQA Shared Task, we have participated in Task 1b by developing a system based on Qwen2.5-VL-7B Instruct with 4-bit quantization. We have reformulated hallucination detection as a single choice selection problem to enforce the exactly one-correct-statement constraint and have introduced confidence-based selective refinement using paraphrase ensemble voting. Our final system has achieved 0.942 accuracy, 0.058 CI, 0.000 CFHR,0.942 Q+accuracy and 0.971 Q−accuracy, ranking 6th in the English track. Error analysis has revealed that the remaining failures have mostly stemmed from fine-grained cultural and visual grounding challenges rather than prediction inconsistency.
Anthology ID:
2026.arabicnlp-sharedtasks.87
Volume:
Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Muhammad Abdul-Mageed, Tamer Elsayed, Houda Bouamor, Samhaa El-Beltagy, Hend Al-Khalifa, Ahmed Abdelali, AbdelRahim Elmadany, Abdellah El Mekki, Kareem Darwish, Sakhar Alkhereyf, Hamzah Luqman, Salam Khalifa, Samar Magdy, Zaid Alyafeai, Injy Hamed, Wajdi Zaghouani, Imed Zitouni
Venue:
ArabicNLP
SIG:
SIGARAB
Publisher:
Association for Computational Linguistics
Note:
Pages:
697–702
Language:
URL:
https://aclanthology.org/2026.arabicnlp-sharedtasks.87/
DOI:
Bibkey:
Cite (ACL):
Sumaiya Zaman and Miftahul Jannat Rishta. 2026. Nile Nexus at ImageEval 2026 Shared Tasks: Single-Choice Reformulation and Confidence-Calibrated Refinement for Culturally Grounded Hallucination Detection. In Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks, pages 697–702, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Nile Nexus at ImageEval 2026 Shared Tasks: Single-Choice Reformulation and Confidence-Calibrated Refinement for Culturally Grounded Hallucination Detection (Zaman & Rishta, ArabicNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.arabicnlp-sharedtasks.87.pdf