Mir Rayat Imtiaz Hossain
Author directory2026
MemeCULT-1K: Benchmarking South Asian Cultural Context and Humor Understanding of Multimodal Models
Tawsif Tashwar Dipto | Mehedi Ahamed | Radib Bin Kabir | Mueeze Al Mushabbir | Mohammed Saidul Islam | Mir Rayat Imtiaz Hossain | Md Tahmid Rahman Laskar | Sabbir Ahmed
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Tawsif Tashwar Dipto | Mehedi Ahamed | Radib Bin Kabir | Mueeze Al Mushabbir | Mohammed Saidul Islam | Mir Rayat Imtiaz Hossain | Md Tahmid Rahman Laskar | Sabbir Ahmed
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Meme understanding goes beyond recognizing visual content or literal text; it requires implicit cultural knowledge and pragmatic inference that most vision-language models still lack. We introduce MemeCULT-1K, a multilingual benchmark of 1,000 South Asian memes in Bengali, English, and Hindi, where each meme is paired with a cultural context note and three human-written explanations, along with a supplementary set of 54 Bengali regional dialect memes. We evaluate thirteen popular Vision Language Models (VLMs) under two settings: meme-only and context-aware. Providing minimal cultural context yields consistent gains across all models and languages: mean SBERT similarity improves from 44.6 to 56.4 (+11.8), BLEURT from 37.3 to 42.3 (+5.0), and LLM-as-a-Judge scores from 2.57 to 3.43 out of 5 (+0.86). Fine-grained error analysis reveals that closed-source models fail mainly on entity and reference misidentification, while open-source models are bottlenecked by broader cultural knowledge gaps, with linguistic and phonological failures proving the most context-resistant across both. These results highlight the difficulty of culturally grounded meme understanding and motivate future work on explicit cultural knowledge integration. Our dataset and code are publicly available at TawsifDipto17/MemeCULT-1K.
CLARUS: Hierarchical Hypergraph Modeling for Unsupervised Discharge Summarization
Gaetano Cimino | Mir Rayat Imtiaz Hossain | Laura De Santis | Amirhossein Abaskohi | Raymond T. Ng | Giuseppe Carenini | Vincenzo Deufemia
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Gaetano Cimino | Mir Rayat Imtiaz Hossain | Laura De Santis | Amirhossein Abaskohi | Raymond T. Ng | Giuseppe Carenini | Vincenzo Deufemia
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Discharge summary generation from clinical records is challenging due to long, heterogeneous inputs and the need to preserve clinically relevant information. Although Large Language Models (LLMs) have improved abstractive summarization, their direct application to full patient records is limited by context length and difficulties in aggregating evidence across notes. We present CLARUS, a fully unsupervised framework that models patient records as hypergraphs encoding multi-dimensional relations. A hierarchical hypergraph encoder with depth-aware concept attention strengthens sparse representations, while a variational information bottleneck with Gumbel-Softmax relaxation enables differentiable selection of compact, informative subsets for LLM generation. Experiments on MIMIC-III show that CLARUS outperforms strong unsupervised baselines across lexical, semantic, and clinical metrics, demonstrating the value of higher-order structure and concept hierarchy for faithful multi-document clinical summarization.
2025
ChartGaze: Enhancing Chart Understanding in LVLMs with Eye-Tracking Guided Attention Refinement
Ali Salamatian | Amirhossein Abaskohi | Wan-Cyuan Fan | Mir Rayat Imtiaz Hossain | Leonid Sigal | Giuseppe Carenini
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Ali Salamatian | Amirhossein Abaskohi | Wan-Cyuan Fan | Mir Rayat Imtiaz Hossain | Leonid Sigal | Giuseppe Carenini
Proceedings of the 2025 Conference on Empirical Methods in Natural Language Processing
Charts are a crucial visual medium for communicating and representing information. While Large Vision-Language Models (LVLMs) have made progress on chart question answering (CQA), the task remains challenging, particularly when models attend to irrelevant regions of the chart. In this work, we present ChartGaze, a new eye-tracking dataset that captures human gaze patterns during chart reasoning tasks. Through a systematic comparison of human and model attention, we find that LVLMs often diverge from human gaze, leading to reduced interpretability and accuracy. To address this, we propose a gaze-guided attention refinement that aligns image-text attention with human fixations. Our approach improves both answer accuracy and attention alignment, yielding gains of up to 2.56 percentage points across multiple models. These results demonstrate the promise of incorporating human gaze to enhance both the reasoning quality and interpretability of chart-focused LVLMs.