SIS@IIITH at SemEval-2020 Task 8: An Overview of Simple Text Classification Methods for Meme Analysis

Sravani Boinepelli, Manish Shrivastava, Vasudeva Varma


Abstract
Memes are steadily taking over the feeds of the public on social media. There is always the threat of malicious users on the internet posting offensive content, even through memes. Hence, the automatic detection of offensive images/memes is imperative along with detection of offensive text. However, this is a much more complex task as it involves both visual cues as well as language understanding and cultural/context knowledge. This paper describes our approach to the task of SemEval-2020 Task 8: Memotion Analysis. We chose to participate only in Task A which dealt with Sentiment Classification, which we formulated as a text classification problem. Through our experiments, we explored multiple training models to evaluate the performance of simple text classification algorithms on the raw text obtained after running OCR on meme images. Our submitted model achieved an accuracy of 72.69% and exceeded the existing baseline’s Macro F1 score by 8% on the official test dataset. Apart from describing our official submission, we shall elucidate how different classification models respond to this task.
Anthology ID:
2020.semeval-1.157
Volume:
Proceedings of the Fourteenth Workshop on Semantic Evaluation
Month:
December
Year:
2020
Address:
Barcelona (online)
Editors:
Aurelie Herbelot, Xiaodan Zhu, Alexis Palmer, Nathan Schneider, Jonathan May, Ekaterina Shutova
Venue:
SemEval
SIG:
SIGLEX
Publisher:
International Committee for Computational Linguistics
Note:
Pages:
1190–1194
Language:
URL:
https://aclanthology.org/2020.semeval-1.157
DOI:
10.18653/v1/2020.semeval-1.157
Bibkey:
Cite (ACL):
Sravani Boinepelli, Manish Shrivastava, and Vasudeva Varma. 2020. SIS@IIITH at SemEval-2020 Task 8: An Overview of Simple Text Classification Methods for Meme Analysis. In Proceedings of the Fourteenth Workshop on Semantic Evaluation, pages 1190–1194, Barcelona (online). International Committee for Computational Linguistics.
Cite (Informal):
SIS@IIITH at SemEval-2020 Task 8: An Overview of Simple Text Classification Methods for Meme Analysis (Boinepelli et al., SemEval 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.semeval-1.157.pdf