Hasan Alkhder
Author directory2026
A Monolingual LoRA-Tuned Qwen2.5-3B System for Arabic Context-Based Question Answering
Hasan Alkhder | Maria Hanini | Imane Hocine | Maher Pasa | Amro Najjar
Proceedings of the Eleventh Conference on Machine Translation
Hasan Alkhder | Maria Hanini | Imane Hocine | Maher Pasa | Amro Najjar
Proceedings of the Eleventh Conference on Machine Translation
In this paper, we describe our submission to the WMT26 Multilingual Instruction Shared Task (MIST), Sub-task 1 (context-based question answering). We fine-tune Qwen2.5-3B-Instruct with a LoRA adapter on 3,112 extractive-QA examples drawn from the answerable subset of TyDi QA as released in the wmt26-mist-sample data. We submit outputs for the monolingual Arabic (question and context both in Arabic) instances of the official qa-context test set. Our system reaches a mean token accuracy of 0.9643 and produces accurate extractive spans. On the held-out split, fine-tuning roughly doubles both exact match (23.81 → 53.97) and token-level F1 (37.00 → 68.52) relative to the base model. The adapter corrects over-refusal tendency in addition to improving span precision. The base model emitted the prescribed no-answer string in 60% of passages with answers, versus 0% for the fine-tuned model. We report error analysis identifying recurring failures, and discuss the model’s weaker behaviour on cross-lingual context instances, which make up the large majority of the official test set, as a direct consequence of training exclusively on monolingual data.
SDNLP at AMIYA 2026: Syrian Arabic Dialect Modeling with LoRA
Hasan Alkhder | Mohammad Abboush
Proceedings of the 13th Workshop on NLP for Similar Languages, Varieties and Dialects
Hasan Alkhder | Mohammad Abboush
Proceedings of the 13th Workshop on NLP for Similar Languages, Varieties and Dialects
Dialectal Arabic continues to represent a persistent challenge for contemporary large language models, which are predominantly trained and optimized for Modern Standard Arabic (MSA) and therefore exhibit limited capability when processing colloquial varieties. In this study, a dedicated system developed for participation in the AMIYA shared task focusing on Syrian Arabic is presented. The proposed solution is based on the integration of parameter-efficient fine-tuning through Low-Rank Adaptation (LoRA) with prompt-guided inference, aiming to enhance dialectal adequacy and linguistic naturalness. Rather than emphasizing strict factual precision, the system is deliberately designed to prioritize fluent and authentic Syrian Arabic generation, in accordance with the evaluation principles adopted by the AL-QASIDA benchmark. This design choice reflects a focus on human-perceived language quality and dialectal fidelity, which are central to effective dialect-aware language modeling.