From Explanation to Detection: Multimodal Insights into Disagreement in Misogynous Memes

Giulia Rizzi, Paolo Rosso, Elisabetta Fersini


Abstract
This paper presents a probabilistic approach to identifying the disagreement-related elements in misogynistic memes by considering both modalities that compose a meme (i.e., visual and textual sources). Several methodologies to exploit such elements in the identification of disagreement among annotators have been investigated and evaluated on the Multimedia Automatic Misogyny Identification (MAMI) dataset. The proposed unsupervised approach reaches comparable performances, and in some cases even better, with state-of-the-art approaches, but with a reduced number of parameters to be estimated.
Anthology ID:
2024.clicit-1.89
Volume:
Proceedings of the 10th Italian Conference on Computational Linguistics (CLiC-it 2024)
Month:
December
Year:
2024
Address:
Pisa, Italy
Editors:
Felice Dell'Orletta, Alessandro Lenci, Simonetta Montemagni, Rachele Sprugnoli
Venue:
CLiC-it
SIG:
Publisher:
CEUR Workshop Proceedings
Note:
Pages:
821–828
Language:
URL:
https://aclanthology.org/2024.clicit-1.89/
DOI:
Bibkey:
Cite (ACL):
Giulia Rizzi, Paolo Rosso, and Elisabetta Fersini. 2024. From Explanation to Detection: Multimodal Insights into Disagreement in Misogynous Memes. In Proceedings of the 10th Italian Conference on Computational Linguistics (CLiC-it 2024), pages 821–828, Pisa, Italy. CEUR Workshop Proceedings.
Cite (Informal):
From Explanation to Detection: Multimodal Insights into Disagreement in Misogynous Memes (Rizzi et al., CLiC-it 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.clicit-1.89.pdf