Neel Sabhahit
Author directoryAlso published as: Neel Ganapathi Sabhahit
2026
NASIMLab at SemEval-2026 Task 9: A Comparative Analysis of Fine-Tuned Small Language Models vs. Generative Large Language Models for Multilingual Polarization Type Detection
Neel Sabhahit | Sanjeevan Selvaganapathy | Mehwish Nasim
Proceedings of the 20th International Workshop on Semantic Evaluation (2026)
Neel Sabhahit | Sanjeevan Selvaganapathy | Mehwish Nasim
Proceedings of the 20th International Workshop on Semantic Evaluation (2026)
The POLAR dataset contains various social media texts that might be polarized (conflict-inducing or dangerously divisive). The task at hand is to identify whether any of the following types of polarization are present: political, racial/ethnic, religious, gender/sexual, and other types across 22 languages. In this paper, we propose a system of fine-tuned language-specific small language models and compare our approach with state-of-the-art large language models on the POLAR dataset. By fine-tuning models for each language, we demonstrate that fine-tuned small encoder-only models consistently outperform large language models, especially for low-resource languages. Our system performs well on this task for most low-resource languages, notably taking the top spot on the leaderboard in Burmese (mya), appearing within the top 10 for 12 languages, and within the top 20 for all remaining languages.
Do LLMs Use Cultural Knowledge Without Being Told? A Multilingual Evaluation of Implicit Pragmatic Adaptation
Mehwish Nasim | Sanjeevan Selvaganapathy | Neel Ganapathi Sabhahit | Marie Griesbach | Pranav Bhandari | Janina Lütke Stockdiek | Lennart Schäpermeier | Usman Naseem | Christian Grimme
Findings of the Association for Computational Linguistics: EMNLP 2026
Mehwish Nasim | Sanjeevan Selvaganapathy | Neel Ganapathi Sabhahit | Marie Griesbach | Pranav Bhandari | Janina Lütke Stockdiek | Lennart Schäpermeier | Usman Naseem | Christian Grimme
Findings of the Association for Computational Linguistics: EMNLP 2026
Many benchmarks show that large language models can answer direct questions about culture. We study a different question: do they also change how they speak when culture is only implied by the situation? We introduce a triad-diagnostic framework; applying it to four deployed endpoints to evaluate 60 culturally grounded conversational scenarios. We examine responses across five languages in three conditions: a neutral baseline (Prompt A), an explicit cultural instruction (Prompt B), and implicit situational cueing (Prompt C). We use an LLM-judge ensemble with explicit rubrics to score responses on 12 pragmatic features covering deference to authority, individual-versus-group framing, and uncertainty management. We define Pragmatic Context Sensitivity (PCS) as the fraction of the judge-scored Prompt A→B feature shift that reappears under Prompt A→C. Across four deployed LLM endpoints and five languages (English, German, Hindi, Nepali, and Urdu), the primary stable-only PCS mean is 0.196 (SD = 0.113), indicating that the tested models recover only about one-fifth of the explicitly prompted rubric-aligned shift. Transfer is strongest for authority-related cues (0.299) and weakest for individual-versus-group framing (0.120). We argue that multilingual cultural pragmatics is an explicit-versus-implicit deployment problem, not only a factual knowledge problem.