UAEM-ITAM at SemEval-2022 Task 5: Vision-Language Approach to Recognize Misogynous Content in Memes

Edgar Roman-Rangel, Jorge Fuentes-Pacheco, Jorge Hermosillo Valadez


Abstract
In the context of the Multimedia Automatic Misogyny Identification (MAMI) competition 2022, we developed a framework for extracting lexical-semantic features from text and combine them with semantic descriptions of images, together with image content representation. We enriched the text modality description by incorporating word representations for each object present within the images. Images and text are then described at two levels of detail, globally and locally, using standard dimensionality reduction techniques for images in order to obtain 4 embeddings for each meme. These embeddings are finally concatenated and passed to a classifier. Our results overcome the baseline by 4%, falling behind the best performance by 12% for Sub-task B.
Anthology ID:
2022.semeval-1.83
Volume:
Proceedings of the 16th International Workshop on Semantic Evaluation (SemEval-2022)
Month:
July
Year:
2022
Address:
Seattle, United States
Editors:
Guy Emerson, Natalie Schluter, Gabriel Stanovsky, Ritesh Kumar, Alexis Palmer, Nathan Schneider, Siddharth Singh, Shyam Ratan
Venue:
SemEval
SIG:
SIGLEX
Publisher:
Association for Computational Linguistics
Note:
Pages:
605–609
Language:
URL:
https://aclanthology.org/2022.semeval-1.83
DOI:
10.18653/v1/2022.semeval-1.83
Bibkey:
Cite (ACL):
Edgar Roman-Rangel, Jorge Fuentes-Pacheco, and Jorge Hermosillo Valadez. 2022. UAEM-ITAM at SemEval-2022 Task 5: Vision-Language Approach to Recognize Misogynous Content in Memes. In Proceedings of the 16th International Workshop on Semantic Evaluation (SemEval-2022), pages 605–609, Seattle, United States. Association for Computational Linguistics.
Cite (Informal):
UAEM-ITAM at SemEval-2022 Task 5: Vision-Language Approach to Recognize Misogynous Content in Memes (Roman-Rangel et al., SemEval 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.semeval-1.83.pdf
Video:
 https://aclanthology.org/2022.semeval-1.83.mp4