HateU at SemEval-2022 Task 5: Multimedia Automatic Misogyny Identification

Ayme Arango, Jesus Perez-Martin, Arniel Labrada


Abstract
Hate speech expressions in social media are not limited to textual messages; they can appear in videos, images, or multimodal formats like memes. Existing work towards detecting such expressions has been conducted almost exclusively over textual content, and the analysis of pictures and videos has been very scarce. This paper describes our team proposal in the Multimedia Automatic Misogyny Identification (MAMI) task at SemEval 2022. The challenge consisted of identifying misogynous memes from a dataset where images and text transcriptions were provided. We reported a 71% of F-score using a multimodal system based on the CLIP model.
Anthology ID:
2022.semeval-1.80
Volume:
Proceedings of the 16th International Workshop on Semantic Evaluation (SemEval-2022)
Month:
July
Year:
2022
Address:
Seattle, United States
Editors:
Guy Emerson, Natalie Schluter, Gabriel Stanovsky, Ritesh Kumar, Alexis Palmer, Nathan Schneider, Siddharth Singh, Shyam Ratan
Venue:
SemEval
SIG:
SIGLEX
Publisher:
Association for Computational Linguistics
Note:
Pages:
581–584
Language:
URL:
https://aclanthology.org/2022.semeval-1.80
DOI:
10.18653/v1/2022.semeval-1.80
Bibkey:
Cite (ACL):
Ayme Arango, Jesus Perez-Martin, and Arniel Labrada. 2022. HateU at SemEval-2022 Task 5: Multimedia Automatic Misogyny Identification. In Proceedings of the 16th International Workshop on Semantic Evaluation (SemEval-2022), pages 581–584, Seattle, United States. Association for Computational Linguistics.
Cite (Informal):
HateU at SemEval-2022 Task 5: Multimedia Automatic Misogyny Identification (Arango et al., SemEval 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.semeval-1.80.pdf