Kareem Elozeiri
Author directory2026
Can Dialects Be Steered Like Languages? Sparse Neurons and Distributed Directions in Arabic LLMs
Kareem Elozeiri | Mervat Abassy | Omar Kallas | Fahim Dalvi | Preslav Nakov | Kentaro Inui | Nadir Durrani
Findings of the Association for Computational Linguistics: EMNLP 2026
Kareem Elozeiri | Mervat Abassy | Omar Kallas | Fahim Dalvi | Preslav Nakov | Kentaro Inui | Nadir Durrani
Findings of the Association for Computational Linguistics: EMNLP 2026
A key challenge in Arabic NLP is the scarcity of dialectal data relative to Modern Standard Arabic (MSA), causing LLMs to overproduce MSA and struggle with dialectally accurate generation. From an interpretability perspective, this raises a fundamental question: where and how are dialectal features encoded within model internals, and can these representations be leveraged to improve dialect generation without fine-tuning? This study investigates two complementary inference-time approaches that serve simultaneously as interpretability probes and control mechanisms. First, we conduct a neuron-level analysis, identifying sparse neuron populations that encode dialect-specific features and showing that amplifying or suppressing these neurons can steer model outputs toward target dialects. Second, motivated by the entanglement of dialectal features at the single-neuron level, we apply a vector-steering approach that extracts dialect-specific activation directions and injects them during inference. Together, these methods illuminate the geometry of dialectal knowledge in Arabic LLMs and offer a principled, interpretability-grounded framework for dialect control without requiring dialect-specific fine-tuning.
Instruction-Guided Poetry Generation in Arabic and Its Dialects
Abdelrahman Sadallah | Kareem Elozeiri | Mervat Abassy | Rania Elbadry | Mohamed Anwar | Abed Alhakim Freihat | Preslav Nakov | Fajri Koto
Findings of the Association for Computational Linguistics: ACL 2026
Abdelrahman Sadallah | Kareem Elozeiri | Mervat Abassy | Rania Elbadry | Mohamed Anwar | Abed Alhakim Freihat | Preslav Nakov | Fajri Koto
Findings of the Association for Computational Linguistics: ACL 2026
Poetry has long been a central art form for Arabic speakers, serving as a powerful medium of expression and cultural identity. While modern Arabic speakers continue to value poetry, existing research on Arabic poetry within Large Language Models (LLMs) has primarily focused on analysis tasks such as interpretation or metadata prediction, e.g., rhyme schemes and titles. In contrast, our work addresses the practical aspect of poetry creation in Arabic by introducing controllable generation capabilities to assist users in writing poetry. Specifically, we present a large-scale, carefully curated instruction-based dataset in Modern Standard Arabic (MSA) and various Arabic dialects. This dataset enables tasks such as writing, revising, and continuing poems based on predefined criteria, including style and rhyme, as well as performing poetry analysis. Our experiments show that fine-tuning LLMs on this dataset yields models that can effectively generate poetry that is aligned with user requirements, based on both automated metrics and human evaluation with native Arabic speakers. The data and the code are available at https://github.com/mbzuai-nlp/instructpoet-ar
Jais 2: A Family of Arabic-Centric Open Large Language Models
Mohamed Anwar | Abed Alhakim Freihat | George Ibrahim | Mostafa Awad | Abdelrahman Sadallah | Gurpreet Gosal | Gokulakrishnan Ramakrishnan | Sarath Chandran | Biswajit Mishra | Rituraj Joshi | Ahmed Frikha | Etienne Goffinet | Abhishek Maiti | Ali El Filali | Sarah AlBarri | Samujjwal Ghosh | Rahul Pal | Parvez Mullah | Awantika Shukla | Sajid Siddiki | Samta Kamboj | Onkar Pandit | Sunil Kumar Sahu | AbdelRahman Elbadawy | Amr Mohamed | Ahmad Chamma | Evan Dufraisse | Abdelaziz Bounhar | Dani Bouch | Hadi Abdine | Guokan Shang | Fajri Koto | Yuxia Wang | Zhuohan Xie | Ali Mekky | Rania Elbadry | Sarfraz Ahmad | Momina Ahsan | Omar El Herraoui | Daniil Orel | Hasan Iqbal | Kareem Elzeky | Mervat Abassy | Kareem Elozeiri | Saadeldine Eletter | Farah Atif | Nurdaulet Mukhituly | Haonan Li | Xudong Han | Aaryamonvikram Singh | Zainul Abedien Ahmed Quraishi | Neha Sengupta | Larry Murray | Avraham Sheinin | Joel Hestness | Natalia Vassilieva | Hector Xuguang Ren | Zhengzhong Liu | Michalis Vazirgiannis | Preslav Nakov
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Mohamed Anwar | Abed Alhakim Freihat | George Ibrahim | Mostafa Awad | Abdelrahman Sadallah | Gurpreet Gosal | Gokulakrishnan Ramakrishnan | Sarath Chandran | Biswajit Mishra | Rituraj Joshi | Ahmed Frikha | Etienne Goffinet | Abhishek Maiti | Ali El Filali | Sarah AlBarri | Samujjwal Ghosh | Rahul Pal | Parvez Mullah | Awantika Shukla | Sajid Siddiki | Samta Kamboj | Onkar Pandit | Sunil Kumar Sahu | AbdelRahman Elbadawy | Amr Mohamed | Ahmad Chamma | Evan Dufraisse | Abdelaziz Bounhar | Dani Bouch | Hadi Abdine | Guokan Shang | Fajri Koto | Yuxia Wang | Zhuohan Xie | Ali Mekky | Rania Elbadry | Sarfraz Ahmad | Momina Ahsan | Omar El Herraoui | Daniil Orel | Hasan Iqbal | Kareem Elzeky | Mervat Abassy | Kareem Elozeiri | Saadeldine Eletter | Farah Atif | Nurdaulet Mukhituly | Haonan Li | Xudong Han | Aaryamonvikram Singh | Zainul Abedien Ahmed Quraishi | Neha Sengupta | Larry Murray | Avraham Sheinin | Joel Hestness | Natalia Vassilieva | Hector Xuguang Ren | Zhengzhong Liu | Michalis Vazirgiannis | Preslav Nakov
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Jais 2 is a family of open-weight, Arabic-centric large language models designed for strong Arabic performance and broad cultural coverage. The family includes, to our knowledge, the largest open Arabic-centric LLM trained from scratch, with 70B parameters, alongside an efficient 8B model. A custom Arabic-centric vocabulary supports efficient training and inference, while an optimized architecture and training recipe improve compute efficiency. Jais 2 achieves the highest scores on the Open Arabic LLM Leaderboard v2 (OALL2) and AraGen v1 among the evaluated open models, while remaining competitive on English benchmarks. It also obtains strong results in Arabic poetry, dream interpretation, translation, and summarization. On the IslamicQA domain, Jais 2-70B achieves the second-highest overall average among the evaluated large open models, while attaining the highest scores on PalmX and the held-out in-house IslamicQA benchmark. We release both model sizes as open-weights on Hugging Face under a commercially permissive license. Jais 2-70B is also available as a chat application on the Web, iOS, and Android, reaching inference speeds of up to 2,000 tokens per second on Cerebras hardware.
Is Human-Like Text Liked by Humans? Multilingual Human Detection and Preference Against AI
Yuxia Wang | Rui Xing | Jonibek Mansurov | Giovanni Puccetti | Zhuohan Xie | Minh Ngoc Ta | Jiahui Geng | Jinyan Su | Mervat Abassy | Saadeldine Eletter | Kareem Elozeiri | Nurkhan Laiyk | Maiya Goloburda | Tarek Mahmoud | Raj Vardhan Tomar | Alexander Aziz | Ryuto Koike | Masahiro Kaneko | Artem Shelmanov | Ekaterina Artemova | Vladislav Mikhailov | Akim Tsvigun | Alham Fikri Aji | Nizar Habash | Iryna Gurevych | Preslav Nakov
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Yuxia Wang | Rui Xing | Jonibek Mansurov | Giovanni Puccetti | Zhuohan Xie | Minh Ngoc Ta | Jiahui Geng | Jinyan Su | Mervat Abassy | Saadeldine Eletter | Kareem Elozeiri | Nurkhan Laiyk | Maiya Goloburda | Tarek Mahmoud | Raj Vardhan Tomar | Alexander Aziz | Ryuto Koike | Masahiro Kaneko | Artem Shelmanov | Ekaterina Artemova | Vladislav Mikhailov | Akim Tsvigun | Alham Fikri Aji | Nizar Habash | Iryna Gurevych | Preslav Nakov
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers)
Prior studies have shown that distinguishing text generated by Large Language Models (LLMs) from human-written one is highly challenging for humans, and often no better than random guessing. To verify the generalizability of this finding across languages and domains, we perform an extensive case study to identify the upper bound of human detection accuracy. Across 16 datasets covering 9 languages and 9 domains, 19 annotators achieved an average detection accuracy of 87.6%, thus challenging previous conclusions. We find that major gaps between human and machine text lie in concreteness, cultural nuances, and diversity. Prompting by explicitly explaining the distinctions in the prompts can partially bridge the gaps in over 50% of the cases. However, we also find that humans do not always prefer human-written text, particularly when they cannot clearly identify its source. We release our dataset, the human labels, and the annotator metadata at https://github.com/xnlp-lab/HumanEval-MGT.
2024
LLM-DetectAIve: a Tool for Fine-Grained Machine-Generated Text Detection
Mervat Abassy | Kareem Elozeiri | Alexander Aziz | Minh Ngoc Ta | Raj Vardhan Tomar | Bimarsha Adhikari | Saad El Dine Ahmed | Yuxia Wang | Osama Mohammed Afzal | Zhuohan Xie | Jonibek Mansurov | Ekaterina Artemova | Vladislav Mikhailov | Rui Xing | Jiahui Geng | Hasan Iqbal | Zain Muhammad Mujahid | Tarek Mahmoud | Akim Tsvigun | Alham Fikri Aji | Artem Shelmanov | Nizar Habash | Iryna Gurevych | Preslav Nakov
Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing: System Demonstrations
Mervat Abassy | Kareem Elozeiri | Alexander Aziz | Minh Ngoc Ta | Raj Vardhan Tomar | Bimarsha Adhikari | Saad El Dine Ahmed | Yuxia Wang | Osama Mohammed Afzal | Zhuohan Xie | Jonibek Mansurov | Ekaterina Artemova | Vladislav Mikhailov | Rui Xing | Jiahui Geng | Hasan Iqbal | Zain Muhammad Mujahid | Tarek Mahmoud | Akim Tsvigun | Alham Fikri Aji | Artem Shelmanov | Nizar Habash | Iryna Gurevych | Preslav Nakov
Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing: System Demonstrations
The ease of access to large language models (LLMs) has enabled a widespread of machine-generated texts, and now it is often hard to tell whether a piece of text was human-written or machine-generated. This raises concerns about potential misuse, particularly within educational and academic domains. Thus, it is important to develop practical systems that can automate the process. Here, we present one such system, LLM-DetectAIve, designed for fine-grained detection. Unlike most previous work on machine-generated text detection, which focused on binary classification, LLM-DetectAIve supports four categories: (i) human-written, (ii) machine-generated, (iii) machine-written, then machine-humanized, and (iv) human-written, then machine-polished. Category (iii) aims to detect attempts to obfuscate the fact that a text was machine-generated, while category (iv) looks for cases where the LLM was used to polish a human-written text, which is typically acceptable in academic writing, but not in education. Our experiments show that LLM-DetectAIve can effectively identify the above four categories, which makes it a potentially useful tool in education, academia, and other domains.LLM-DetectAIve is publicly accessible at https://github.com/mbzuai-nlp/LLM-DetectAIve. The video describing our system is available at https://youtu.be/E8eT_bE7k8c.
Search
Fix author
Co-authors
- Mervat Abassy 5
- Preslav Nakov 5
- Saadeldine Eletter 3
- Yuxia Wang 3
- Zhuohan Xie 3
- Alham Fikri Aji 2
- Mohamed Anwar 2
- Ekaterina Artemova 2
- Alexander Aziz 2
- Rania Elbadry 2
- Abed Alhakim Freihat 2
- Jiahui Geng 2
- Iryna Gurevych 2
- Nizar Habash 2
- Hasan Iqbal 2
- Fajri Koto 2
- Tarek Mahmoud 2
- Jonibek Mansurov 2
- Vladislav Mikhailov 2
- Abdelrahman Sadallah 2
- Artem Shelmanov 2
- Minh Ngoc Ta 2
- Raj Vardhan Tomar 2
- Akim Tsvigun 2
- Rui Xing 2
- Hadi Abdine 1
- Bimarsha Adhikari 1
- Osama Mohammed Afzal 1
- Sarfraz Ahmad 1
- Momina Ahsan 1
- Sarah AlBarri 1
- Farah Atif 1
- Mostafa Awad 1
- Dani Bouch 1
- Abdelaziz Bounhar 1
- Ahmad Chamma 1
- Sarath Chandran 1
- Fahim Dalvi 1
- Evan Dufraisse 1
- Nadir Durrani 1
- Ali El Filali 1
- Omar El Herraoui 1
- AbdelRahman Elbadawy 1
- Kareem Elzeky 1
- Ahmed Frikha 1
- Samujjwal Ghosh 1
- Etienne Goffinet 1
- Maiya Goloburda 1
- Gurpreet Gosal 1
- Xudong Han 1
- Joel Hestness 1
- George Ibrahim 1
- Kentaro Inui 1
- Rituraj Joshi 1
- Omar Kallas 1
- Samta Kamboj 1
- Masahiro Kaneko 1
- Ryuto Koike 1
- Nurkhan Laiyk 1
- Haonan Li 1
- Zhengzhong Liu 1
- Abhishek Maiti 1
- Ali Mekky 1
- Biswajit Mishra 1
- Amr Mohamed 1
- Zain Muhammad Mujahid 1
- Nurdaulet Mukhituly 1
- Parvez Mullah 1
- Larry Murray 1
- Daniil Orel 1
- Rahul Pal 1
- Onkar Arun Pandit 1
- Giovanni Puccetti 1
- Zainul Abedien Ahmed Quraishi 1
- Gokulakrishnan Ramakrishnan 1
- Hector Xuguang Ren 1
- Sunil Kumar Sahu 1
- Neha Sengupta 1
- Guokan Shang 1
- Avraham Sheinin 1
- Awantika Shukla 1
- Sajid Siddiki 1
- Aaryamonvikram Singh 1
- Jinyan Su 1
- Natalia Vassilieva 1
- Michalis Vazirgiannis 1