Stance Prediction and Claim Verification: An Arabic Perspective

Jude Khouja


Abstract
This work explores the application of textual entailment in news claim verification and stance prediction using a new corpus in Arabic. The publicly available corpus comes in two perspectives: a version consisting of 4,547 true and false claims and a version consisting of 3,786 pairs (claim, evidence). We describe the methodology for creating the corpus and the annotation process. Using the introduced corpus, we also develop two machine learning baselines for two proposed tasks: claim verification and stance prediction. Our best model utilizes pretraining (BERT) and achieves 76.7 F1 on the stance prediction task and 64.3 F1 on the claim verification task. Our preliminary experiments shed some light on the limits of automatic claim verification that relies on claims text only. Results hint that while the linguistic features and world knowledge learned during pretraining are useful for stance prediction, such learned representations from pretraining are insufficient for verifying claims without access to context or evidence.
Anthology ID:
2020.fever-1.2
Volume:
Proceedings of the Third Workshop on Fact Extraction and VERification (FEVER)
Month:
July
Year:
2020
Address:
Online
Editors:
Christos Christodoulopoulos, James Thorne, Andreas Vlachos, Oana Cocarascu, Arpit Mittal
Venue:
FEVER
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
8–17
Language:
URL:
https://aclanthology.org/2020.fever-1.2
DOI:
10.18653/v1/2020.fever-1.2
Bibkey:
Cite (ACL):
Jude Khouja. 2020. Stance Prediction and Claim Verification: An Arabic Perspective. In Proceedings of the Third Workshop on Fact Extraction and VERification (FEVER), pages 8–17, Online. Association for Computational Linguistics.
Cite (Informal):
Stance Prediction and Claim Verification: An Arabic Perspective (Khouja, FEVER 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.fever-1.2.pdf
Video:
 http://slideslive.com/38929660
Code
 latynt/ans