Amrita Chaturvedi

Author directory

2026

Humor recognition in conversations is a highly challenging task due to its reliance on context, sarcasm, timing, and multimodal cues. While several humour datasets exist for English, resources for Indic languages like Hindi remain little scarce, limiting the development of culturally aware conversational AI systems. To address this gap, we introduce a new multimodal dataset for humour detection from conversational dialogues. The dataset consists of 5203 annotated utterances of 2 season containing 8 episodes each from a popular Indian web series Panchayat. Utterances are kept in their original Devanagari script as spoken in the series, without transliteration or standardization into pure Hindi, to retain the natural conversational tone and cultural nuances. Each utterance is annotated with a binary humour label (Humour / Not Humour) and includes aligned textual, acoustic and visual information, making it suitable for multimodal and context-aware humour research. Our experiments highlight the complementary nature of multimodal signals and the importance of conversational context in understanding Hindi humour. This dataset is expected to promote research on computational humour, sarcasm detection and multimodal dialogue understanding for low-resource languages. The dataset and baselines are available at https://huggingface.co/datasets/Abhis4e/Panchayat-multimodal-dataset and https://github.com/singhbishtabhishek/Multimodal-Dataset.