Dialectal Arabic remains significantly underrepresented in parallel resources for direct machine translation with English, particularly for regional varieties such as Saudi Najdi Arabic. In this work, we introduce NAJD-MT, a systematically constructed Saudi Najdi-English parallel corpus designed for training bidirectional neural machine translation models. Starting from the Saudi Arabic Dialectal Annotated (SADA) dataset, we generate English translations using GPT-4.1 and subsequently apply cross-lingual embedding-based cosine similarity filtering to improve semantic alignment and reduce translation noise. We analyze the impact of varying semantic similarity thresholds on corpus size and downstream translation performance. Using the constructed datasets, we train and evaluate multiple Transformer-based models, including NLLB-200, OPUS-MT, mBART, and AraT5v2, in both Najdi→English and English→Najdi directions. Experimental results demonstrate that stricter semantic filtering (cosine ≥ 0.7) consistently improves translation quality despite reducing dataset size, highlighting that data purity plays a critical role in dialectal machine translation training. Our findings provide a reproducible framework for constructing high-fidelity dialect English parallel corpora and emphasize the importance of semantic alignment filtering in low-resource dialectal settings.

Modern visual document retrieval (VDR) models remain strongly English-centric, leaving Arabic substantially under-served in this rapidly advancing field. To address this gap, we introduce DEAM, the first open Arabic visual document retrieval dataset explicitly designed for fine-tuning and evaluating multimodal retrievers on Arabic. DEAM is built through a human-in-the-loop construction pipeline with annotators community annotators, combining Arabic document rendering, query creation, validation, and retrieval-oriented hard-negative mining. The dataset comprises18,275 rendered Arabic documents spanning nine source domains and 82,727 contrastive retrieval triplets, each including five mined hard negatives and one easy negative for contrastive fine-tuning. Zero-shot evaluation of 27 retrievers shows that multilingual text retrievers outperform visual retrievers on Arabic by 13.6 nDCG@10, except on layout-rich news pages. DEAM establishes a public foundation for Arabic visual document retrieval.https://huggingface.co/collections/NAMAA-Space/deam-for-arabic-multimodal-retrieval

Stance detection identifies an author’s position toward a specified target, yet Arabic social-media text remains challenging because stance is often implicit and shaped by dialect, sarcasm, informal expression, and culturally specific references. StanceEval-2026 evaluates this problem in two transfer settings: a related target within a seen thematic domain (Track 1) and entirely unseen topics (Track 2). We compare four modeling strategies: single-task Arabic encoder fine-tuning, multi-task learning with sentiment and sarcasm supervision, 4-bit QLoRA adaptation of the ALLaM-7B model, and Retrieval-Augmented In-Context Learning (RAG-ICL) with frozen large language models (LLMs). Our strongest single-backend configuration is a data-centric RAG-ICL pipeline combining label-balanced retrieval, hashtag and negation adaptation, text cleaning, similarity filtering, and target descriptions. A majority-vote ensemble of this configuration across three LLM backends obtains official F_avg2 scores of 0.8719 on Track 1 and 0.9016 on Track 2, ranking 3rd and 7th, respectively. Under the shared-task test conditions, the retrieval-based systems substantially outperform the supervised systems evaluated here, particularly on Track 2.

Arabic machine translation benchmarks provide limited coverage of variation within Saudi Arabic. We introduce SAFIR, a Saudi-centric benchmark of 610 unique sentence pairs organized into 12 creator specific evaluation splits across five regional groups: Najdi, Hijazi, Southern, Northern, and Eastern. Native speakers authored the Arabic sentences and their English translations; 235 pairs received independent double review for dialect authenticity, translation adequacy, and fluency. We evaluate twelve systems, comprising losed-weight LLMs, open-weight LLMs, and dedicated MT models, in the zero-shot Saudi→English setting using reference-based metrics and GPT-4o judgments. Closed-weight LLMs obtain the strongest aggregate results. Gemini 2.5 Pro achieves the highest average BLEU (34.41), while GPT-5 achieves the highest BERTScore (83.60). Rankings vary across splits, and Southern varieties present particular challenges in judged adequacy. Differences between reference overlap, adequacy, and fluency support reporting performance by sampled variety and evaluation dimension. SAFIR and its leaderboard support more detailed assessment of Saudi Arabic translation.

Arabic Large Language Models are usually evaluated using Western-centric benchmarks that overlook essential cultural contexts, making them less effective and culturally misaligned for Arabic-speaking communities. This study addresses this gap by evaluating the Arabic Massive Multitask Language Understanding (MMLU) Benchmark to assess its cultural alignment and relevance for Arabic Large Language Models (LLMs) across culturally sensitive topics. A team of eleven experts annotated over 2,500 questions, evaluating them based on fluency, adequacy, cultural appropriateness, bias detection, religious sensitivity, and adherence to social norms. Through human assessment, the study highlights significant cultural misalignments and biases, particularly in sensitive areas like religion and morality. In response to these findings, we propose annotation guidelines and integrate culturally enriched data sources to enhance the benchmark’s reliability and relevance. The research highlights the importance of cultural sensitivity in evaluating inclusive Arabic LLMs, fostering more widely accepted LLMs for Arabic-speaking communities.

Mainstream large vision-language models (LVLMs) inherently encode cultural biases, highlighting the need for diverse multimodal datasets. To address this gap, we introduce PEARL, a large-scale Arabic multimodal dataset and benchmark explicitly designed for cultural understanding. Constructed through advanced agentic workflows and extensive human-in-the-loop annotations by 37 annotators from across the Arab world, PEARL comprises over 309K multimodal examples spanning ten culturally significant domains covering all Arab countries. We further provide two robust evaluation benchmarks (PEARL and PEARL-LITE) along with a specialized subset (PEARL-X) explicitly developed to assess nuanced cultural variations. Comprehensive evaluations on state-of-the-art open and proprietary LVLMs demonstrate that reasoning-centric instruction alignment substantially improves models’ cultural grounding compared to conventional scaling methods. PEARL establishes a foundational resource for advancing culturally-informed multimodal modeling research. All datasets and benchmarks are publicly available.