ShadowDZ at HalluScoring-2026: A Fine-Tuned Fanar Approach for Islamic Knowledge Hallucination Detection

Faiz Kraimia, Aicha Eutamene


Abstract
Large language models used for question answering can produce fluent but factually incorrect answers, a problem that is acute in knowledge-sensitive domains such as Islamic religious knowledge. We describe our system for the HalluScoring 2026 shared task (Islamic Knowledge track), which requires jointly detecting hallucinated answers and selecting the correct option among six candidates. We fine-tune Fanar-1-9B-Instruct with LoRA and decompose inference into two independently-prompted steps, judging hallucination before revealing the candidate options, to prevent a textual-similarity shortcut where one option is a near-verbatim restatement of the generated answer. Our system scores 0.7149 (Assisted) and 0.6222 (Blind) on the official hidden test set, ranking 5th of 5 reported teams; a controlled comparison shows this shortcut-resistant design costs roughly 10 points against a single-pass variant on a held-out development subsample (0.7625 vs. 0.8639 Combined Score). We release our code and model to support further work on this trade-off.
Anthology ID:
2026.arabicnlp-sharedtasks.147
Volume:
Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Muhammad Abdul-Mageed, Tamer Elsayed, Houda Bouamor, Samhaa El-Beltagy, Hend Al-Khalifa, Ahmed Abdelali, AbdelRahim Elmadany, Abdellah El Mekki, Kareem Darwish, Sakhar Alkhereyf, Hamzah Luqman, Salam Khalifa, Samar Magdy, Zaid Alyafeai, Injy Hamed, Wajdi Zaghouani, Imed Zitouni
Venue:
ArabicNLP
SIG:
SIGARAB
Publisher:
Association for Computational Linguistics
Note:
Pages:
1176–1181
Language:
URL:
https://aclanthology.org/2026.arabicnlp-sharedtasks.147/
DOI:
Bibkey:
Cite (ACL):
Faiz Kraimia and Aicha Eutamene. 2026. ShadowDZ at HalluScoring-2026: A Fine-Tuned Fanar Approach for Islamic Knowledge Hallucination Detection. In Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks, pages 1176–1181, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
ShadowDZ at HalluScoring-2026: A Fine-Tuned Fanar Approach for Islamic Knowledge Hallucination Detection (Kraimia & Eutamene, ArabicNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.arabicnlp-sharedtasks.147.pdf