A Multi-Modal Method for Satire Detection using Textual and Visual Cues

Lily Li, Or Levi, Pedram Hosseini, David Broniatowski


Abstract
Satire is a form of humorous critique, but it is sometimes misinterpreted by readers as legitimate news, which can lead to harmful consequences. We observe that the images used in satirical news articles often contain absurd or ridiculous content and that image manipulation is used to create fictional scenarios. While previous work have studied text-based methods, in this work we propose a multi-modal approach based on state-of-the-art visiolinguistic model ViLBERT. To this end, we create a new dataset consisting of images and headlines of regular and satirical news for the task of satire detection. We fine-tune ViLBERT on the dataset and train a convolutional neural network that uses an image forensics technique. Evaluation on the dataset shows that our proposed multi-modal approach outperforms image-only, text-only, and simple fusion baselines.
Anthology ID:
2020.nlp4if-1.4
Volume:
Proceedings of the 3rd NLP4IF Workshop on NLP for Internet Freedom: Censorship, Disinformation, and Propaganda
Month:
December
Year:
2020
Address:
Barcelona, Spain (Online)
Editors:
Giovanni Da San Martino, Chris Brew, Giovanni Luca Ciampaglia, Anna Feldman, Chris Leberknight, Preslav Nakov
Venue:
NLP4IF
SIG:
Publisher:
International Committee on Computational Linguistics (ICCL)
Note:
Pages:
33–38
Language:
URL:
https://aclanthology.org/2020.nlp4if-1.4
DOI:
Bibkey:
Cite (ACL):
Lily Li, Or Levi, Pedram Hosseini, and David Broniatowski. 2020. A Multi-Modal Method for Satire Detection using Textual and Visual Cues. In Proceedings of the 3rd NLP4IF Workshop on NLP for Internet Freedom: Censorship, Disinformation, and Propaganda, pages 33–38, Barcelona, Spain (Online). International Committee on Computational Linguistics (ICCL).
Cite (Informal):
A Multi-Modal Method for Satire Detection using Textual and Visual Cues (Li et al., NLP4IF 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.nlp4if-1.4.pdf
Code
 lilyli2004/satire
Data
Satire DatasetConceptual Captions