Hunzalah Hassan Bhatti
Author directory2026
Beyond MCQ: An Open-Ended Arabic Cultural QA Benchmark with Dialect Variants
Hunzalah Hassan Bhatti | Firoj Alam
Proceedings of the Fifteenth Language Resources and Evaluation Conference
Hunzalah Hassan Bhatti | Firoj Alam
Proceedings of the Fifteenth Language Resources and Evaluation Conference
Large Language Models (LLMs) are increasingly used to answer everyday questions, yet their performance on culturally grounded and dialectal content remains limited across languages and their varieties. We propose a comprehensive method that (i) translates Modern Standard Arabic (MSA) multiple-choice questions (MCQs) into English and several Arabic dialects, (ii) converts them into open-ended questions (OEQs), (iii) benchmarks a range of zero-shot and fine-tuned LLMs under both MCQ and OEQ settings, and (iv) generates chain-of-thought (CoT) rationales to fine-tune models for step-by-step reasoning. Using this method, we extend an existing dataset in which QAs are parallelly aligned across language varieties, making it, to our knowledge, the first of its kind. A large portion of the resulting test set is further validated through targeted human annotation and native-speaker post-editing. We conduct extensive experiments with both open and closed models. Our findings show that (i) models underperform on Arabic dialects, showing persistent gaps in culturally grounded and dialect-specific knowledge; (ii) Arabic-centric models perform well on MCQs but struggle with OEQs; and (iii) CoT improves judged correctness while yielding mixed n-gram-based metrics.
Multi-turn Conversational AI from Text to Multimodal Interaction: Data, Models, Evaluation, and Open Challenges
Syeda Faiza Ahmed Sara | Zien Sheikh Ali | Hunzalah Hassan Bhatti | Firoj Alam | Shammur Absar Chowdhury
Findings of the Association for Computational Linguistics: EMNLP 2026
Syeda Faiza Ahmed Sara | Zien Sheikh Ali | Hunzalah Hassan Bhatti | Firoj Alam | Shammur Absar Chowdhury
Findings of the Association for Computational Linguistics: EMNLP 2026
Conversational AI is moving beyond isolated text prompts toward sustained, multimodal interaction. In real conversations, users clarify goals, revise requests, interrupt responses, switch topics, and introduce new evidence while expecting systems to preserve context across turns. This makes multi-turn dialogue a distinct challenge requiring systems to maintain and update memory, ground responses across modalities, tools, and external knowledge, and adapt across languages and cultures. This study reviews ***multi-turn conversational AI*** across text-only dialogue, AudioLLMs and speech-native systems, multimodal and omni-modal systems, and tool-augmented agents. We organize the literature around *datasets* and *benchmarks*, *modeling paradigms*, *training strategies*, *evaluation setups*, and *cross-cutting challenges*. Our analysis shows that support for multiple modalities has advanced faster than the ability to sustain coherent interaction across a session. Despite stronger capabilities to perceive, speak, and act across modalities, current systems still struggle with persistent memory, cross-turn grounding, full-duplex interaction, robust evaluation, and cultural alignment. We conclude with a research agenda for systems that can remember, revise, ground, speak, listen, act, and adapt across turns, modalities, and cultures. ([https://github.com/faiza-sfa/multiturn-conversational-ai-survey](https://github.com/faiza-sfa/multiturn-conversational-ai-survey))
MENASpeechBank: A Reference Voice Bank with Persona-Conditioned Multi-Turn Conversations for SpeechLLMs
Zien Sheikh Ali | Hunzalah Hassan Bhatti | Rabindra Nath Nandi | Shammur Absar Chowdhury | Firoj Alam
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Zien Sheikh Ali | Hunzalah Hassan Bhatti | Rabindra Nath Nandi | Shammur Absar Chowdhury | Firoj Alam
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Audio large language models (AudioLLMs) enable instruction following over speech and general audio, but progress is limited by the scarcity of *diverse, conversational, and instruction-aligned* speech-text data. This gap is particularly pronounced for persona-grounded and dialectal interactions, where collecting real multi-speaker recordings remains costly and slow. We introduce **MENASpeechBank**, a reference speech bank comprising **∼18K high-quality utterances** from **124 speakers** spanning multiple MENA countries, covering English, Modern Standard Arabic (MSA), and regional Arabic varieties. We develop a controllable data pipeline that *(i)* constructs persona profiles enriched with World Values Survey (WVS) inspired attributes, *(ii)* defines a taxonomy driven ∼5Kconversational scenarios, *(iii)* matches personas to scenarios via semantic similarity, *(iv)* generates ∼417K role-play conversations with an LLM where the user speaks as the persona and the assistant behaves as a helpful agent, and *(v)* produces speaker-conditioned user-turn audio (synthetic) from reference recordings to preserve speaker diversity. We evaluate synthetic and human recorded conversations and provide an analysis. We will make the MENASpeechBank available for the community.([https://huggingface.co/datasets/QCRI/MenaSpeechBank](https://huggingface.co/datasets/QCRI/MenaSpeechBank))
ImageEval 2026: Culturally Grounded Arabic Multimodal Evaluation
Samir Abdaljalil | Hunzalah Hassan Bhatti | Ahlam Bashiti | Farina Amir | Md Arid Hasan | Basel Mousi | Nadir Durrani | Fahim Dalvi | Zien Sheikh Ali | Erchin Serpedin | Hasan Kurban | Mustafa Jarrar | Shammur Absar Chowdhury | Firoj Alam
Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks
Samir Abdaljalil | Hunzalah Hassan Bhatti | Ahlam Bashiti | Farina Amir | Md Arid Hasan | Basel Mousi | Nadir Durrani | Fahim Dalvi | Zien Sheikh Ali | Erchin Serpedin | Hasan Kurban | Mustafa Jarrar | Shammur Absar Chowdhury | Firoj Alam
Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks
Aslema at NADI 2026: Data Augmentation for Intent Recognition and Slot Filling
Tajwaar Shafiq | Hunzalah Hassan Bhatti | Firoj Alam | Shammur Absar Chowdhury
Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks
Tajwaar Shafiq | Hunzalah Hassan Bhatti | Firoj Alam | Shammur Absar Chowdhury
Proceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks