Vescera at HalluScoring 2026: Privileged-Information Distillation with Contrastive Representation Alignment for Arabic Hallucination Detection

Abdellah Zakaria Sellam, Ahmed Marouane Djouama, Ilyes Benaissa, Fadi Abdeladhim Zidi, Mohamed Amine Kerkouri, Marouane Tliba, Aladine Chetouani


Abstract
HalluScoring 2026 Subtask 2.2 (Hallucination Detection & Find the Truth) requires systems to judge whether an Arabic generated answer is hallucinated and to select the correct one among six candidates, without access to the reference answer that would make both judgments trivial. We treat that withheld reference as privileged information: a teacher is fine-tuned with it in the prompt, then never deployed, and its advantage is transferred to a blind student through two channels knowledge distillation over the teacher’s output distribution, and a contrastive privileged-information (CPI) term that aligns the student’s hidden representation with the teacher’s gold-conditioned one. Our fine-tuned ALLaM-7B attains 84.62 combined score (Comb) on the official test set and 83.47 on the dev set.
Anthology ID:
2026.arabicnlp-sharedtasks.139
Volume:
Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Muhammad Abdul-Mageed, Tamer Elsayed, Houda Bouamor, Samhaa El-Beltagy, Hend Al-Khalifa, Ahmed Abdelali, AbdelRahim Elmadany, Abdellah El Mekki, Kareem Darwish, Sakhar Alkhereyf, Hamzah Luqman, Salam Khalifa, Samar Magdy, Zaid Alyafeai, Injy Hamed, Wajdi Zaghouani, Imed Zitouni
Venue:
ArabicNLP
SIG:
SIGARAB
Publisher:
Association for Computational Linguistics
Note:
Pages:
1126–1130
Language:
URL:
https://aclanthology.org/2026.arabicnlp-sharedtasks.139/
DOI:
Bibkey:
Cite (ACL):
Abdellah Zakaria Sellam, Ahmed Marouane Djouama, Ilyes Benaissa, Fadi Abdeladhim Zidi, Mohamed Amine Kerkouri, Marouane Tliba, and Aladine Chetouani. 2026. Vescera at HalluScoring 2026: Privileged-Information Distillation with Contrastive Representation Alignment for Arabic Hallucination Detection. In Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks, pages 1126–1130, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Vescera at HalluScoring 2026: Privileged-Information Distillation with Contrastive Representation Alignment for Arabic Hallucination Detection (Zakaria Sellam et al., ArabicNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.arabicnlp-sharedtasks.139.pdf