BennettNLP at SemEval-2020 Task 8: Multimodal sentiment classification Using Hybrid Hierarchical Classifier

Ambuje Gupta, Harsh Kataria, Souvik Mishra, Tapas Badal, Vipul Mishra


Abstract
Memotion analysis is a very crucial and important subject in today’s world that is dominated by social media. This paper presents the results and analysis of the SemEval-2020 Task-8: Memotion analysis by team Kraken that qualified as winners for the task. This involved performing multimodal sentiment analysis on memes commonly posted over social media. The task comprised of 3 subtasks, Task A was to find the overall sentiment of a meme and classify it into positive, negative or neutral, Task B was to classify it into the different types which were namely humour, sarcasm, offensive or motivation where a meme could have more than one category, Task C was to further quantify the classifications achieved in task B. An imbalanced data of 6992 rows was utilized for this which contained images (memes), text (extracted OCR) and their annotations in 17 classes provided by the task organisers. In this paper, the authors proposed a hybrid neural Naïve-Bayes Support Vector Machine and logistic regression to solve a multilevel 17 class classification problem. It achieved the best result in Task B i.e 0.70 F1 score. The authors were ranked third in Task B.
Anthology ID:
2020.semeval-1.143
Volume:
Proceedings of the Fourteenth Workshop on Semantic Evaluation
Month:
December
Year:
2020
Address:
Barcelona (online)
Editors:
Aurelie Herbelot, Xiaodan Zhu, Alexis Palmer, Nathan Schneider, Jonathan May, Ekaterina Shutova
Venue:
SemEval
SIG:
SIGLEX
Publisher:
International Committee for Computational Linguistics
Note:
Pages:
1085–1093
Language:
URL:
https://aclanthology.org/2020.semeval-1.143
DOI:
10.18653/v1/2020.semeval-1.143
Bibkey:
Cite (ACL):
Ambuje Gupta, Harsh Kataria, Souvik Mishra, Tapas Badal, and Vipul Mishra. 2020. BennettNLP at SemEval-2020 Task 8: Multimodal sentiment classification Using Hybrid Hierarchical Classifier. In Proceedings of the Fourteenth Workshop on Semantic Evaluation, pages 1085–1093, Barcelona (online). International Committee for Computational Linguistics.
Cite (Informal):
BennettNLP at SemEval-2020 Task 8: Multimodal sentiment classification Using Hybrid Hierarchical Classifier (Gupta et al., SemEval 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.semeval-1.143.pdf