Poirot at SemEval-2022 Task 5: Leveraging Graph Network for Misogynistic Meme Detection

Harshvardhan Srivastava


Abstract
In recent years, there has been an upsurge in a new form of entertainment medium called memes. These memes although seemingly innocuous have transcended the boundary of online harassment against women and created an unwanted bias against them. To help alleviate this problem, we propose an early fusion model for the prediction and identification of misogynistic memes and their type in this paper for which we participated in SemEval-2022 Task 5. The model receives as input meme image with its text transcription with a target vector. Given that a key challenge with this task is the combination of different modalities to predict misogyny, our model relies on pre-trained contextual representations from different state-of-the-art transformer-based language models and pre-trained image models to get an effective image representation. Our model achieved competitive results on both SubTask-A and SubTask-B with the other competingteams and significantly outperforms the baselines.
Anthology ID:
2022.semeval-1.110
Volume:
Proceedings of the 16th International Workshop on Semantic Evaluation (SemEval-2022)
Month:
July
Year:
2022
Address:
Seattle, United States
Editors:
Guy Emerson, Natalie Schluter, Gabriel Stanovsky, Ritesh Kumar, Alexis Palmer, Nathan Schneider, Siddharth Singh, Shyam Ratan
Venue:
SemEval
SIG:
SIGLEX
Publisher:
Association for Computational Linguistics
Note:
Pages:
793–801
Language:
URL:
https://aclanthology.org/2022.semeval-1.110
DOI:
10.18653/v1/2022.semeval-1.110
Bibkey:
Cite (ACL):
Harshvardhan Srivastava. 2022. Poirot at SemEval-2022 Task 5: Leveraging Graph Network for Misogynistic Meme Detection. In Proceedings of the 16th International Workshop on Semantic Evaluation (SemEval-2022), pages 793–801, Seattle, United States. Association for Computational Linguistics.
Cite (Informal):
Poirot at SemEval-2022 Task 5: Leveraging Graph Network for Misogynistic Meme Detection (Srivastava, SemEval 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.semeval-1.110.pdf
Data
Hateful Memes