IslamicEval 2026 Subtask 4 asks whether a Qur’anic or Hadith citation is useful for answering an Arabic question, rather than merely related to its topic. We treat this decision as ranking under shared response context. An Arabic instruction prompt is scored by the first answer-token logit difference between na’am ("yes") and la ("no"). We adapt ALLaM 7B with LoRA and a response-balanced RankNet loss over 1,063 positive-negative pairs drawn from 348 mixed-label responses. At inference, the model uses deterministic logits and one calibrated threshold; it does not generate or sample an answer. On Development, the frozen checkpoint obtained 0.867761 Question Macro-F1 under question-grouped out-of-fold threshold calibration, compared with 0.777935 for zero-shot ALLaM. Our primary submission, AhmedNLP_AllamR, scored 0.767880 on the official test and was the best of our three submitted runs. The largest Development-to-test drop occurred on all-negative questions. This result suggests retaining pairwise supervision while adding direct supervision for homogeneous negative groups.