Gurpreet Gosal
Author directory2026
Jais 2: A Family of Arabic-Centric Open Large Language Models
Mohamed Anwar | Abed Alhakim Freihat | George Ibrahim | Mostafa Awad | Abdelrahman Sadallah | Gurpreet Gosal | Gokulakrishnan Ramakrishnan | Sarath Chandran | Biswajit Mishra | Rituraj Joshi | Ahmed Frikha | Etienne Goffinet | Abhishek Maiti | Ali El Filali | Sarah AlBarri | Samujjwal Ghosh | Rahul Pal | Parvez Mullah | Awantika Shukla | Sajid Siddiki | Samta Kamboj | Onkar Pandit | Sunil Kumar Sahu | AbdelRahman Elbadawy | Amr Mohamed | Ahmad Chamma | Evan Dufraisse | Abdelaziz Bounhar | Dani Bouch | Hadi Abdine | Guokan Shang | Fajri Koto | Yuxia Wang | Zhuohan Xie | Ali Mekky | Rania Elbadry | Sarfraz Ahmad | Momina Ahsan | Omar El Herraoui | Daniil Orel | Hasan Iqbal | Kareem Elzeky | Mervat Abassy | Kareem Elozeiri | Saadeldine Eletter | Farah Atif | Nurdaulet Mukhituly | Haonan Li | Xudong Han | Aaryamonvikram Singh | Zainul Abedien Ahmed Quraishi | Neha Sengupta | Larry Murray | Avraham Sheinin | Joel Hestness | Natalia Vassilieva | Hector Xuguang Ren | Zhengzhong Liu | Michalis Vazirgiannis | Preslav Nakov
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Mohamed Anwar | Abed Alhakim Freihat | George Ibrahim | Mostafa Awad | Abdelrahman Sadallah | Gurpreet Gosal | Gokulakrishnan Ramakrishnan | Sarath Chandran | Biswajit Mishra | Rituraj Joshi | Ahmed Frikha | Etienne Goffinet | Abhishek Maiti | Ali El Filali | Sarah AlBarri | Samujjwal Ghosh | Rahul Pal | Parvez Mullah | Awantika Shukla | Sajid Siddiki | Samta Kamboj | Onkar Pandit | Sunil Kumar Sahu | AbdelRahman Elbadawy | Amr Mohamed | Ahmad Chamma | Evan Dufraisse | Abdelaziz Bounhar | Dani Bouch | Hadi Abdine | Guokan Shang | Fajri Koto | Yuxia Wang | Zhuohan Xie | Ali Mekky | Rania Elbadry | Sarfraz Ahmad | Momina Ahsan | Omar El Herraoui | Daniil Orel | Hasan Iqbal | Kareem Elzeky | Mervat Abassy | Kareem Elozeiri | Saadeldine Eletter | Farah Atif | Nurdaulet Mukhituly | Haonan Li | Xudong Han | Aaryamonvikram Singh | Zainul Abedien Ahmed Quraishi | Neha Sengupta | Larry Murray | Avraham Sheinin | Joel Hestness | Natalia Vassilieva | Hector Xuguang Ren | Zhengzhong Liu | Michalis Vazirgiannis | Preslav Nakov
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Jais 2 is a family of open-weight, Arabic-centric large language models designed for strong Arabic performance and broad cultural coverage. The family includes, to our knowledge, the largest open Arabic-centric LLM trained from scratch, with 70B parameters, alongside an efficient 8B model. A custom Arabic-centric vocabulary supports efficient training and inference, while an optimized architecture and training recipe improve compute efficiency. Jais 2 achieves the highest scores on the Open Arabic LLM Leaderboard v2 (OALL2) and AraGen v1 among the evaluated open models, while remaining competitive on English benchmarks. It also obtains strong results in Arabic poetry, dream interpretation, translation, and summarization. On the IslamicQA domain, Jais 2-70B achieves the second-highest overall average among the evaluated large open models, while attaining the highest scores on PalmX and the held-out in-house IslamicQA benchmark. We release both model sizes as open-weights on Hugging Face under a commercially permissive license. Jais 2-70B is also available as a chat application on the Web, iOS, and Android, reaching inference speeds of up to 2,000 tokens per second on Cerebras hardware.
Nanda Family: Open-Weights Generative Large Language Models for Hindi
Aaryamonvikram Singh | Debopriyo Banerjee | Dhruv Sahnan | Monojit Choudhury | Shivam Chauhan | Rocktim Jyoti Das | Xudong Han | Haonan Li | Alok Anil Jadhav | Utkarsh Agarwal | Mukund Choudhary | Fajri Koto | Junaid Hamid Bhat | Awantika Shukla | Samujjwal Ghosh | Samta Kamboj | Onkar Pandit | Lalit Pradhan | Rahul Pal | Sunil Kumar Sahu | Parvez Mullah | Ali El Filali | Zainul Abedien Ahmed Quraishi | Neha Sengupta | Gokulakrishnan Ramakrishnan | Rituraj Joshi | Gurpreet Gosal | Avraham Sheinin | Natalia Vassilieva | Preslav Nakov
Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)
Aaryamonvikram Singh | Debopriyo Banerjee | Dhruv Sahnan | Monojit Choudhury | Shivam Chauhan | Rocktim Jyoti Das | Xudong Han | Haonan Li | Alok Anil Jadhav | Utkarsh Agarwal | Mukund Choudhary | Fajri Koto | Junaid Hamid Bhat | Awantika Shukla | Samujjwal Ghosh | Samta Kamboj | Onkar Pandit | Lalit Pradhan | Rahul Pal | Sunil Kumar Sahu | Parvez Mullah | Ali El Filali | Zainul Abedien Ahmed Quraishi | Neha Sengupta | Gokulakrishnan Ramakrishnan | Rituraj Joshi | Gurpreet Gosal | Avraham Sheinin | Natalia Vassilieva | Preslav Nakov
Proceedings of the 19th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers)
Large language models remain predominantly English-centric, which limits their utility for underrepresented languages. We help bridge this gap for Hindi with Llama-3-Nanda-10B-Chat (aka Nanda-10B) and Llama-3.1-Nanda-87B-Chat (aka Nanda-87B), forming the Nanda family of open-weight bilingual models (https://github.com/MBZUAI-IFM/Nanda-Family). Our approach integrates: (i) a tokenizer extending Llama’s vocabulary with 20% Hindi-specific tokens, thus halving Hindi tokenization fertility while preserving English efficiency, (ii) Hindi-first parameter-efficient continual pretraining using Llama Pro on a 65B-token corpus spanning Devanagari script, code-mixed, and Romanized Hindi, and (iii) bilingual instruction and safety alignment on a large culturally grounded dataset. The resulting Nanda models outperform open-weight LLMs of comparable size: Nanda-87B yields high generative quality, and Nanda-10B shows competitive general-purpose performance. Nanda-87B demonstrates state-of-the-art performance on summarization, translation, transliteration, and instruction following. Moreover, both models achieve state-of-the-art performance in safety and in cultural knowledge. Our results demonstrate that careful tokenizer design, data curation, and continual pretraining can yield capable and safe LLMs for resource-poor languages without compromising English performance.
Search
Fix author
Co-authors
- Ali El Filali 2
- Samujjwal Ghosh 2
- Xudong Han 2
- Rituraj Joshi 2
- Samta Kamboj 2
- Fajri Koto 2
- Haonan Li 2
- Parvez Mullah 2
- Preslav Nakov 2
- Rahul Pal 2
- Onkar Arun Pandit 2
- Zainul Abedien Ahmed Quraishi 2
- Gokulakrishnan Ramakrishnan 2
- Sunil Kumar Sahu 2
- Neha Sengupta 2
- Avraham Sheinin 2
- Awantika Shukla 2
- Aaryamonvikram Singh 2
- Natalia Vassilieva 2
- Mervat Abassy 1
- Hadi Abdine 1
- Utkarsh Agarwal 1
- Sarfraz Ahmad 1
- Momina Ahsan 1
- Sarah AlBarri 1
- Mohamed Anwar 1
- Farah Atif 1
- Mostafa Awad 1
- Debopriyo Banerjee 1
- Junaid Hamid Bhat 1
- Dani Bouch 1
- Abdelaziz Bounhar 1
- Ahmad Chamma 1
- Sarath Chandran 1
- Shivam Chauhan 1
- Mukund Choudhary 1
- Monojit Choudhury 1
- Rocktim Jyoti Das 1
- Evan Dufraisse 1
- Omar El Herraoui 1
- AbdelRahman Elbadawy 1
- Rania Elbadry 1
- Saadeldine Eletter 1
- Kareem Elozeiri 1
- Kareem Elzeky 1
- Abed Alhakim Freihat 1
- Ahmed Frikha 1
- Etienne Goffinet 1
- Joel Hestness 1
- George Ibrahim 1
- Hasan Iqbal 1
- Alok Anil Jadhav 1
- Zhengzhong Liu 1
- Abhishek Maiti 1
- Ali Mekky 1
- Biswajit Mishra 1
- Amr Mohamed 1
- Nurdaulet Mukhituly 1
- Larry Murray 1
- Daniil Orel 1
- Lalit Pradhan 1
- Hector Xuguang Ren 1
- Abdelrahman Sadallah 1
- Dhruv Sahnan 1
- Guokan Shang 1
- Sajid Siddiki 1
- Michalis Vazirgiannis 1
- Yuxia Wang 1
- Zhuohan Xie 1