Mohamed Zaytoon

Author directory

2026

Arabic information retrieval increasingly relies on multi-stage pipelines in which a fast first-stage retriever produces candidate passages and a neural reranker refines relevance. While transformer cross-encoders deliver strong effectiveness through joint query–passage encoding, multilingual rerankers achieve competitive performance on Arabic benchmarks. However, systematic analysis of calibration, robustness, and deployment behavior in Arabic-specific settings remains limited. We present GATE-Reranker, a compact Arabic cross-encoder initialized from an Arabic semantic embedding backbone and fine-tuned on large-scale mMARCO-style Arabic triplets. The model scores each query–passage pair via full self-attention and a lightweight regression head, enabling plug-and-play second-stage reranking for Arabic search and RAG systems. We evaluate on three Arabic benchmarks covering binary relevance discrimination, controlled multi-negative reranking, and large-scale mMARCO evaluation. While remaining competitive with strong multilingual rerankers in ranking effectiveness, GATE-Reranker demonstrates significantly improved calibration and discriminative behavior. These properties translate into more reliable downstream performance in retrieval and RAG pipelines, while maintaining low GPU memory and latency on a Tesla T4.
Modern visual document retrieval (VDR) models remain strongly English-centric, leaving Arabic substantially under-served in this rapidly advancing field. To address this gap, we introduce DEAM, the first open Arabic visual document retrieval dataset explicitly designed for fine-tuning and evaluating multimodal retrievers on Arabic. DEAM is built through a human-in-the-loop construction pipeline with annotators community annotators, combining Arabic document rendering, query creation, validation, and retrieval-oriented hard-negative mining. The dataset comprises18,275 rendered Arabic documents spanning nine source domains and 82,727 contrastive retrieval triplets, each including five mined hard negatives and one easy negative for contrastive fine-tuning. Zero-shot evaluation of 27 retrievers shows that multilingual text retrievers outperform visual retrievers on Arabic by 13.6 nDCG@10, except on layout-rich news pages. DEAM establishes a public foundation for Arabic visual document retrieval.https://huggingface.co/collections/NAMAA-Space/deam-for-arabic-multimodal-retrieval
Arabic knowledge graph construction is a challenging problem due to the linguistic complexity of Arabic and the need for robust generalization across domains. This paper presents our systems for the KnowledgeGraphEval 2026 shared task on Arabic knowledge graph construction and domain adaptation, covering two subtasks: AdaptNER for cross-domain named entity recognition and relation extraction (RE). For AdaptNER, we employ an entity-span ensemble combining two BIO sequence taggers with constrained conditional random field (CRF) decoding and a GlobalPointer span classifier. Our system achieved a micro-F1 score of 76.00%, ranking first in the official evaluation. For relation extraction, we use a majority-vote ensemble of three LoRA-fine-tuned causal language models. This approach achieved a micro-F1 score of 93.48%, ranking fifth. These results demonstrate the effectiveness of model ensembling and complementary prediction strategies for Arabic named-entity recognition and relation extraction.

2025

The swift progress and widespread acceptance of artificial intelligence (AI) systems highlight a pressing requirement to comprehend both the capabilities and potential risks associated with AI. Given the linguistic complexity, cultural richness, and underrepresented status of Arabic in AI research, there is a pressing need to focus on Large Language Models (LLMs) performance and safety for Arabic related tasks. Despite some progress in their development, there is a lack of comprehensive trustworthiness evaluation benchmarks which presents a major challenge in accurately assessing and improving the safety of LLMs when prompted in Arabic. In this paper, we introduce AraTrust, the first comprehensive trustworthiness benchmark for LLMs in Arabic. AraTrust comprises 522 human-written multiple-choice questions addressing diverse dimensions related to truthfulness, ethics, privacy, illegal activities, mental health, physical health, unfairness, and offensive language. We evaluated a set of LLMs against our benchmark to assess their trustworthiness. GPT-4 was the most trustworthy LLM, while open-source models, particularly AceGPT 7B and Jais 13B, struggled to achieve a score of 60% in our benchmark. The benchmark dataset is publicly available at https://huggingface.co/datasets/asas-ai/AraTrust

2024

The rise of memes as a tool for spreading propaganda presents a significant challenge in the current digital environment. In this paper, we outline our work for the ArAIEval Shared Task2 in ArabicNLP 2024. This study introduces a method for identifying propaganda in Arabic memes using a multimodal system that combines textual and visual indicators to enhance the result. Our approach achieves the first place in text classification with Macro-F1 of 78.69%, the third place in image classification with Macro-F1 of 65.92%, and the first place in multimodal classification with Macro-F1 of 80.51%