Enhancing Information Retrieval in Fact Extraction and Verification

Daniel Guzman Olivares, Lara Quijano, Federico Liberatore


Abstract
Modern fact verification systems have distanced themselves from the black box paradigm by providing the evidence used to infer their veracity judgments. Hence, evidence-backed fact verification systems’ performance heavily depends on the capabilities of their retrieval component to identify these facts. A popular evaluation benchmark for these systems is the FEVER task, which consists of determining the veracity of short claims using sentences extracted from Wikipedia. In this paper, we present a novel approach to the the retrieval steps of the FEVER task leveraging the graph structure of Wikipedia. The retrieval models surpass state of the art results at both sentence and document level. Additionally, we show that by feeding our retrieved evidence to the best-performing textual entailment model, we set a new state of the art in the FEVER competition.
Anthology ID:
2023.fever-1.4
Volume:
Proceedings of the Sixth Fact Extraction and VERification Workshop (FEVER)
Month:
May
Year:
2023
Address:
Dubrovnik, Croatia
Editors:
Mubashara Akhtar, Rami Aly, Christos Christodoulopoulos, Oana Cocarascu, Zhijiang Guo, Arpit Mittal, Michael Schlichtkrull, James Thorne, Andreas Vlachos
Venue:
FEVER
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
38–48
Language:
URL:
https://aclanthology.org/2023.fever-1.4
DOI:
10.18653/v1/2023.fever-1.4
Bibkey:
Cite (ACL):
Daniel Guzman Olivares, Lara Quijano, and Federico Liberatore. 2023. Enhancing Information Retrieval in Fact Extraction and Verification. In Proceedings of the Sixth Fact Extraction and VERification Workshop (FEVER), pages 38–48, Dubrovnik, Croatia. Association for Computational Linguistics.
Cite (Informal):
Enhancing Information Retrieval in Fact Extraction and Verification (Guzman Olivares et al., FEVER 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.fever-1.4.pdf
Video:
 https://aclanthology.org/2023.fever-1.4.mp4