Identifying Nuances in Fake News vs. Satire: Using Semantic and Linguistic Cues

Or Levi, Pedram Hosseini, Mona Diab, David Broniatowski


Abstract
The blurry line between nefarious fake news and protected-speech satire has been a notorious struggle for social media platforms. Further to the efforts of reducing exposure to misinformation on social media, purveyors of fake news have begun to masquerade as satire sites to avoid being demoted. In this work, we address the challenge of automatically classifying fake news versus satire. Previous work have studied whether fake news and satire can be distinguished based on language differences. Contrary to fake news, satire stories are usually humorous and carry some political or social message. We hypothesize that these nuances could be identified using semantic and linguistic cues. Consequently, we train a machine learning method using semantic representation, with a state-of-the-art contextual language model, and with linguistic features based on textual coherence metrics. Empirical evaluation attests to the merits of our approach compared to the language-based baseline and sheds light on the nuances between fake news and satire. As avenues for future work, we consider studying additional linguistic features related to the humor aspect, and enriching the data with current news events, to help identify a political or social message.
Anthology ID:
D19-5004
Original:
D19-5004v1
Version 2:
D19-5004v2
Volume:
Proceedings of the Second Workshop on Natural Language Processing for Internet Freedom: Censorship, Disinformation, and Propaganda
Month:
November
Year:
2019
Address:
Hong Kong, China
Editors:
Anna Feldman, Giovanni Da San Martino, Alberto Barrón-Cedeño, Chris Brew, Chris Leberknight, Preslav Nakov
Venue:
NLP4IF
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
31–35
Language:
URL:
https://aclanthology.org/D19-5004
DOI:
10.18653/v1/D19-5004
Bibkey:
Cite (ACL):
Or Levi, Pedram Hosseini, Mona Diab, and David Broniatowski. 2019. Identifying Nuances in Fake News vs. Satire: Using Semantic and Linguistic Cues. In Proceedings of the Second Workshop on Natural Language Processing for Internet Freedom: Censorship, Disinformation, and Propaganda, pages 31–35, Hong Kong, China. Association for Computational Linguistics.
Cite (Informal):
Identifying Nuances in Fake News vs. Satire: Using Semantic and Linguistic Cues (Levi et al., NLP4IF 2019)
Copy Citation:
PDF:
https://aclanthology.org/D19-5004.pdf
Code
 adverifai/Satire_vs_Fake