Adib Sakhawat
Author directory2026
AIDG: A Formal Decomposition of Information Extraction and Containment Asymmetries in Multi-Turn LLM Dialogue
Adib Sakhawat | Fardeen Sadab | Rakin Shahriar
Proceedings of the Second Workshop for REsearch on Agent Language Models (REALM 2026)
Adib Sakhawat | Fardeen Sadab | Rakin Shahriar
Proceedings of the Second Workshop for REsearch on Agent Language Models (REALM 2026)
Multi-turn LLM evaluation is typically reported as a single win-rate scalar, conflating distinct capabilities. We introduce AIDG (Adversarial Information Deduction Game), formalizing multi-turn adversarial dialogue as a two-player partially observable stochastic game (POSG) and decomposing performance along Seeker (extraction) and Holder (containment) roles. The decomposition isolates three failure modes: cooperative-prior leakage, constraint–reasoning interference, and inefficient hypothesis-space traversal. Across 439 games over six frontier LLMs, defensive performance is tightly clustered (σ = 1.9 ELO) while offensive performance varies substantially (σ = 53.3 ELO); confirmation framing increases extraction odds 7.75× over uninformed deduction (p < 0.00001); and constraint violations account for 41.3% of deductive failures, uncorrelated with scale (ρ = 0.0). We position the containment-over-extraction gap not as a surprising finding but as a measurable consequence of locally-resolvable defensive decisions versus globally-coupled offensive planning, and use the decomposition to attribute the gap per model. All design choices, including turn-decay weighting and the Bradley–Terry rating model, are derived from explicit assumptions.
Two Emojis of Difference: What Multilingual Affective Generation Benchmarks Actually Measure
Fardeen Sadab | Adib Sakhawat
Proceedings of the 6th Workshop on Multilingual Representation Learning (MRL 2026)
Fardeen Sadab | Adib Sakhawat
Proceedings of the 6th Workshop on Multilingual Representation Learning (MRL 2026)
We audit a multilingual affective generation benchmark eight instruction-tuned LLMs producing emoji summaries for 17,100 Bangla, English and Hindi sentences, with 6,960 human judgements and find its headline conclusions to be artefacts of the measurement instrument rather than properties of the systems. Treating annotators as a random rather than a fixed factor, no system differs significantly from any other (F(7,14)=0.59, p=0.76), although the conventional analysis declares 19 of 28 pairwise differences significant. Annotator identity explains far more rating variance than system identity, and the winning system changes whenever any single annotator is removed. The ordering that does emerge tracks output length: mean emoji count explains 78.7% of between-system variance, and a within-item length-matched comparison over 2,599 pairs reverses the leaderboard. We further show that cross-provider anisotropy differences vanish under mean-centring, that per-language token costs change sign with the normalising unit, and that multi-view row-wise splits inflate macro-F1 by 3.1 points and change the top-ranked system. In place of preference scoring we propose **emoji-affect decodability**, a reference-based probe whose rankings are stable to ±0.003 macro-F1 across seeds.
When Words Don’t Mean What They Say: Figurative Understanding in Bengali Idioms
Adib Sakhawat | Shamim Ara Parveen | Md Ruhul Amin | Tahera Khatun | Shamim Al Mahmud | Md Saiful Islam
Proceedings of the Fifteenth Language Resources and Evaluation Conference
Adib Sakhawat | Shamim Ara Parveen | Md Ruhul Amin | Tahera Khatun | Shamim Al Mahmud | Md Saiful Islam
Proceedings of the Fifteenth Language Resources and Evaluation Conference
Figurative language understanding remains a significant challenge for Large Language Models (LLMs), especially for low-resource languages. To address this, we introduce the Bangla Bagdhara dataset, a large-scale, culturally grounded corpus of 10,361 Bengali idioms. Each idiom is annotated under a comprehensive 19-field schema, established and refined through a deliberative expert consensus process that captures its semantic, syntactic, cultural, and religious dimensions, providing a rich and structured resource for computational linguistics. To establish a robust benchmark for Bangla figurative language understanding, we evaluate 30 state-of-the-art multilingual and instruction-tuned LLMs on the task of inferring figurative meaning. Our results reveal a critical performance gap, with no model surpassing 50% accuracy, in stark contrast to significantly higher human performance (83.4%). This finding underscores the limitations of existing models in cross-linguistic and cultural reasoning. By releasing the Bangla Bagdhara dataset and benchmark, we provide foundational infrastructure for advancing figurative language understanding and cultural grounding in LLMs for Bengali and other low-resource languages.