Lulwah AlKulaib

Author directory

2026

We present a reference-based evaluation framework for CRAI-Bench, Task 2 of ImageEval 2026. The method uses GPT-5.4 to extract cultural evidence from the reference image, caption, and generated image. This evidence is converted into metric-specific numerical features and mapped to CRAI scores using a small regressor trained on the released data. On the development set, the proposed approach improves composite Spearman correlation over direct GPT-5.4 scoring, with strong gains on certain metrics. We also analyze performance across caption versions and show that evaluation becomes less reliable for some dimensions as captions become more generic.

2024

The increasing use of artificial intelligence in healthcare requires robust datasets for training and validation, particularly in the domain of medical conversations. However, the creation and accessibility of such datasets in Arabic face significant challenges, especially due to the sensitivity and privacy concerns that are associated with medical conversations. These conversations are rarely recorded or preserved, making the availability of comprehensive Arabic medical dialogue datasets scarce. This limitation slows down not only the development of effective natural language processing models but also restricts the opportunity for open comparison of algorithms and their outcomes. Recent advancements in large language models (LLMs) like ChatGPT, GPT-4, Gemini-pro, and Claude-3 show promising capabilities in generating synthetic data. To address this gap, we introduce a novel Multi-Agent LLM approach capable of generating synthetic Arabic medical dialogues from patient notes, regardless of the original language. This development presents a significant step towards overcoming the barriers in dataset availability, enhancing the potential for broader research and application in AI-driven medical dialogue systems.