Israa Elhosiny

Author directory

2026

We present ASCAT (Arabic Scientific Corpus for Advanced Translation), a high-quality English-Arabic parallel benchmark corpus designed for scientific translation evaluation constructed through a systematic multi-engine machine translation and expert post-editing pipeline. Unlike existing Arabic-English corpora that rely on short sentences or single-domain text, ASCAT targets full scientific abstracts averaging 125.3 words (English) and 111.78 words (Arabic), drawn from five scientific domains: physics, mathematics, computer science, quantum mechanics, and artificial intelligence. Each abstract was translated using three complementary architectures generative AI (Gemini), transformer-based models (Hugging Face quickmt-en-ar), and commercial MT APIs (Google Translate, DeepL) and subsequently post-edited by domain experts at the lexical, syntactic, and semantic levels. The resulting corpus contains 67,293 English tokens and 60,026 Arabic tokens, with an Arabic vocabulary of 17,604 unique words reflecting the morphological richness of the language. We benchmark three state-of-the-art LLMs on the corpus GPT-4o-mini (BLEU: 37.07), Gemini-3.0-Flash-Preview (BLEU: 30.44), and Qwen3-235B-A22B (BLEU: 23.68) demonstrating its discriminative power as an evaluation benchmark. ASCAT addresses a critical gap in scientific MT resources for Arabic and is designed to support rigorous evaluation of scientific translation quality and training of domain-specific translation models.
Modern visual document retrieval (VDR) models remain strongly English-centric, leaving Arabic substantially under-served in this rapidly advancing field. To address this gap, we introduce DEAM, the first open Arabic visual document retrieval dataset explicitly designed for fine-tuning and evaluating multimodal retrievers on Arabic. DEAM is built through a human-in-the-loop construction pipeline with annotators community annotators, combining Arabic document rendering, query creation, validation, and retrieval-oriented hard-negative mining. The dataset comprises18,275 rendered Arabic documents spanning nine source domains and 82,727 contrastive retrieval triplets, each including five mined hard negatives and one easy negative for contrastive fine-tuning. Zero-shot evaluation of 27 retrievers shows that multilingual text retrievers outperform visual retrievers on Arabic by 13.6 nDCG@10, except on layout-rich news pages. DEAM establishes a public foundation for Arabic visual document retrieval.https://huggingface.co/collections/NAMAA-Space/deam-for-arabic-multimodal-retrieval
Hierarchical, definition-guided genre classification places a short Arabic text under a broad genre and, within it, a fine-grained specific genre, using only a natural-language definition of each. We present NAMAA’s submission to AraGenre 2026. Fine-tuned bi-encoder classifiers reached 0.93 hierarchical macro F1 on development via data augmentation and cross-lingual pretraining, but collapsed to as low as 0.22 on the released test set, having specialized to a hand-engineered definition style that missed the test set’s larger, 74-genre taxonomy. We root-caused this gap and switched to zero-shot LLM classification, matching the best fine-tuned ensemble’s test score (0.6899 hierarchical F1) with no training; layering self-consistency sampling and disagreement resolution raised this further to 0.7013, ranking 3rd of 18 teams. Specific Macro F1 (0.5114) lags well behind Broad Macro F1 (0.8913), showing that most remaining errors concentrate in fine-grained genre choices rather than broad-category mistakes. Zero-shot LLM prompting generalizes across this definition and taxonomy shift where fine-tuned, definition-conditioned encoders do not. We release our code and system resources to support reproducibility and further research.[<https://github.com/NAMAA-ORG/Aragenre-Definition-Guided-Genre>].
Fine-grained Arabic readability assessment is challenging due to the language’s rich morphology and the ordered nature of readability labels. We investigate this problem in the sentence-level Strict Track of the BAREC Shared Task 2026, which uses a 19-level readability scale. We evaluate six controlled configurations spanning engineered linguistic and morphological features, TF-IDF/SVD lexical representations, contextual transformer encoders, multi-encoder fusion, output-level ensembling, and ordinal-aware training, followed by a final refinement using a single EmbeddingGemma encoder. Contextual transformer representations provide the largest improvement over classical feature-based baselines, while multi-encoder fusion and voting yield smaller additional gains. In contrast, word-repetition and adjacent-word-swap augmentation degrades performance, indicating that these perturbations do not reliably preserve readability labels. Our strongest configuration combines EmbeddingGemma with Gaussian soft labels, KL-divergence training, expected-value decoding, class weighting, and best-checkpoint selection, achieving 84.0 QWK on the test set and 82.4 QWK on the official blind test set. Overall, the results suggest that explicitly accounting for the ordinal structure of readability labels is a promising alternative to simply increasing architectural or ensemble complexity. We further summarize the resulting design insights into a practical framework for Arabic ordinal readability modeling.
Large language models may generate inaccurate Islamic citations when answering religious questions. We present the Namaa Community system for Subtask 2 of IslamicEval 2026, which identifies hallucinations in Qur’anic verses (Ayah), hadith texts (matn), chains of narration (isnad), and claimed sources. We formulate the task as retrieval-grounded verification: citation spans are normalized and matched against the Qur’an and the six major hadith collections using character n-gram retrieval and edit-distance re-ranking. Type-specific verifiers assess Ayah and matn similarity, while claimed sources and isnads are checked against their parent citations. The deterministic pipeline requires no language model or GPU, and every decision is traceable to a canonical record. It achieves a macro accuracy of 0.846 on the development set, 17.9 percentage points above a per-type majority-class baseline, and 0.668 on the official blind test; we trace most of that shortfall to a submission-time configuration error and decompose the remainder by segment type. Our code and submissions are publicly available at https://github.com/NAMAA-ORG/Namaa-Community-at-IslamicEval-2026.