Automated Evidence Collection for Fake News Detection

Mrinal Rawat, Diptesh Kanojia


Abstract
Fake news, misinformation, and unverifiable facts on social media platforms propagate disharmony and affect society, especially when dealing with an epidemic like COVID-19. The task of Fake News Detection aims to tackle the effects of such misinformation by classifying news items as fake or real. In this paper, we propose a novel approach that improves over the current automatic fake news detection approaches by automatically gathering evidence for each claim. Our approach extracts supporting evidence from the web articles and then selects appropriate text to be treated as evidence sets. We use a pre-trained summarizer on these evidence sets and then use the extracted summary as supporting evidence to aid the classification task. Our experiments, using both machine learning and deep learning-based methods, help perform an extensive evaluation of our approach. The results show that our approach outperforms the state-of-the-art methods in fake news detection to achieve an F1-score of 99.25 over the dataset provided for the CONSTRAINT-2021 Shared Task. We also release the augmented dataset, our code and models for any further research.
Anthology ID:
2021.icon-main.55
Volume:
Proceedings of the 18th International Conference on Natural Language Processing (ICON)
Month:
December
Year:
2021
Address:
National Institute of Technology Silchar, Silchar, India
Editors:
Sivaji Bandyopadhyay, Sobha Lalitha Devi, Pushpak Bhattacharyya
Venue:
ICON
SIG:
Publisher:
NLP Association of India (NLPAI)
Note:
Pages:
456–464
Language:
URL:
https://aclanthology.org/2021.icon-main.55
DOI:
Bibkey:
Cite (ACL):
Mrinal Rawat and Diptesh Kanojia. 2021. Automated Evidence Collection for Fake News Detection. In Proceedings of the 18th International Conference on Natural Language Processing (ICON), pages 456–464, National Institute of Technology Silchar, Silchar, India. NLP Association of India (NLPAI).
Cite (Informal):
Automated Evidence Collection for Fake News Detection (Rawat & Kanojia, ICON 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.icon-main.55.pdf
Code
 rawat-mrinal06/fake_news
Data
COVID-19 Fake News DatasetFEVERLIAR