Memebusters at SemEval-2020 Task 8: Feature Fusion Model for Sentiment Analysis on Memes Using Transfer Learning

Mayukh Sharma, Ilanthenral Kandasamy, W.b. Vasantha


Abstract
In this paper, we describe our deep learning system used for SemEval 2020 Task 8: Memotion analysis. We participated in all the subtasks i.e Subtask A: Sentiment classification, Subtask B: Humor classification, and Subtask C: Scales of semantic classes. Similar multimodal architecture was used for each subtask. The proposed architecture makes use of transfer learning for images and text feature extraction. The extracted features are then fused together using stacked bidirectional Long Short Term Memory (LSTM) and Gated Recurrent Unit (GRU) model with attention mechanism for final predictions. We also propose a single model for predicting semantic classes (Subtask B) as well as their scales (Subtask C) by branching the final output of the post LSTM dense layers. Our model was ranked 5 in Subtask B and ranked 8 in Subtask C and performed nicely in Subtask A on the leader board. Our system makes use of transfer learning for feature extraction and fusion of image and text features for predictions.
Anthology ID:
2020.semeval-1.154
Volume:
Proceedings of the Fourteenth Workshop on Semantic Evaluation
Month:
December
Year:
2020
Address:
Barcelona (online)
Venues:
COLING | SemEval
SIGs:
SIGSEM | SIGLEX
Publisher:
International Committee for Computational Linguistics
Note:
Pages:
1163–1171
Language:
URL:
https://aclanthology.org/2020.semeval-1.154
DOI:
10.18653/v1/2020.semeval-1.154
Bibkey:
Cite (ACL):
Mayukh Sharma, Ilanthenral Kandasamy, and W.b. Vasantha. 2020. Memebusters at SemEval-2020 Task 8: Feature Fusion Model for Sentiment Analysis on Memes Using Transfer Learning. In Proceedings of the Fourteenth Workshop on Semantic Evaluation, pages 1163–1171, Barcelona (online). International Committee for Computational Linguistics.
Cite (Informal):
Memebusters at SemEval-2020 Task 8: Feature Fusion Model for Sentiment Analysis on Memes Using Transfer Learning (Sharma et al., SemEval 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.semeval-1.154.pdf
Data
Memotion Analysis