Elham Vatankhahan Esfahani
Author directory2026
APARSIN: A Multi-Variety Sentiment and Translation Benchmark for Iranic Languages
Sadegh Jafari | Tara Azin | Farhad Roodi | Zahra Dehghani Tafti | Mehrdad Ghadrdan | Elham Vatankhahan Esfahani | Aylin Naebzadeh | Mohammadhadi Shahhosseini | Ghafoor Khan | Kazem Forghani | Danial Namazi | Seyed Mohammad Hossein Hashemi | Farhan Farsi | Mohammad Osoolian | Maede Mohammadi | Mohammad Erfan Zare | Muhammad Hasnain Khan | Muhammad Hussain | Nooreen Zaki | Joma Mohammadi | Shayan Bali | Mohammad Javad Ranjbar | Els Lefever | Veronique Hoste
The Proceedings of the First Workshop on NLP and LLMs for the Iranian Language Family
Sadegh Jafari | Tara Azin | Farhad Roodi | Zahra Dehghani Tafti | Mehrdad Ghadrdan | Elham Vatankhahan Esfahani | Aylin Naebzadeh | Mohammadhadi Shahhosseini | Ghafoor Khan | Kazem Forghani | Danial Namazi | Seyed Mohammad Hossein Hashemi | Farhan Farsi | Mohammad Osoolian | Maede Mohammadi | Mohammad Erfan Zare | Muhammad Hasnain Khan | Muhammad Hussain | Nooreen Zaki | Joma Mohammadi | Shayan Bali | Mohammad Javad Ranjbar | Els Lefever | Veronique Hoste
The Proceedings of the First Workshop on NLP and LLMs for the Iranian Language Family
The Iranic language family includes many underrepresented languages and dialects that remain largely unexplored in modern NLP research. We introduce APARSIN, a multi-variety benchmark covering 14 Iranic languages, dialects, and accents, designed for sentiment analysis and machine translation. The dataset includes both high and low-resource varieties, several of which are endangered, capturing linguistic variation across them. We evaluate a set of instruction-tuned Large Language Models (LLMs) on these tasks and analyze their performance across the varieties. Our results highlight substantial performance gaps between standard Persian and other Iranic languages and dialects, demonstrating the need for more inclusive multilingual and dialectally diverse NLP benchmarks.
I Am Working So Hard, Can’t You See?: Physical vs. Cognitive Labor Gender Bias in LLMs in Persian and English
Elham Vatankhahan Esfahani | Sahar Bahrami Khorshid | Ramin Golshaie
Proceedings of the 7th Workshop on Gender Bias in Natural Language Processing (GeBNLP)
Elham Vatankhahan Esfahani | Sahar Bahrami Khorshid | Ramin Golshaie
Proceedings of the 7th Workshop on Gender Bias in Natural Language Processing (GeBNLP)
Gender bias in LLMs has been documented across many overt domains, such as colors, emotions, and occupations, while subtler forms rooted in household labor remain understudied. Following Daminger (2019), we distinguish physical household tasks from their cognitive counterparts, which are rarely recognized as labor despite being time-consuming. We adapt the name-generation probing method of Kalhor and Bahrak (2025) to ten household domains, each phrased as both a physical task and its cognitive counterpart, and evaluate six open-source models from three model families in Persian and English. On average, cognitive tasks receive a higher share of feminine names than their physical counterparts in both languages (Wilcoxon signed-rank test); the direction holds in 8 of 10 domains in Persian and 6 of 10 in English. Averaged over models and tasks, skew toward one gender is larger in English than in Persian, in contrast to the overall pattern reported for other domains, but prompts and labeling procedures differ across languages, so we treat this comparison as suggestive. Our results indicate that the cross-linguistic strength of gender bias depends on the domain and model rather than being a fixed property of a language pair.
Search
Fix author
Co-authors
- Tara Azin 1
- Shayan Bali 1
- Farhan Farsi 1
- Kazem Forghani 1
- Mehrdad Ghadrdan 1
- Ramin Golshaie 1
- Seyed Mohammad Hossein Hashemi 1
- Veronique Hoste 1
- Muhammad Hussain 1
- Sadegh Jafari 1
- Ghafoor Khan 1
- Muhammad Hasnain Khan 1
- Sahar Bahrami Khorshid 1
- Els Lefever 1
- Joma Mohammadi 1
- Maede Mohammadi 1
- Aylin Naebzadeh 1
- Danial Namazi 1
- Mohammad Osoolian 1
- Mohammad Javad Ranjbar Kalahroodi 1
- Farhad Roodi 1
- Mohammadhadi Shahhosseini 1
- Zahra Dehghani Tafti 1
- Nooreen Zaki 1
- Mohammad Erfan Zare 1