FaBULOUS: Fact-checking Based on Understanding of Language Over Unstructured and Structured information

Mostafa Bouziane, Hugo Perrin, Amine Sadeq, Thanh Nguyen, Aurélien Cluzeau, Julien Mardas


Abstract
As part of the FEVEROUS shared task, we developed a robust and finely tuned architecture to handle the joint retrieval and entailment on text data as well as structured data like tables. We proposed two training schemes to tackle the hurdles inherent to multi-hop multi-modal datasets. The first one allows having a robust retrieval of full evidence sets, while the second one enables entailment to take full advantage of noisy evidence inputs. In addition, our work has revealed important insights and potential avenue of research for future improvement on this kind of dataset. In preliminary evaluation on the FEVEROUS shared task test set, our system achieves 0.271 FEVEROUS score, with 0.4258 evidence recall and 0.5607 entailment accuracy.
Anthology ID:
2021.fever-1.4
Volume:
Proceedings of the Fourth Workshop on Fact Extraction and VERification (FEVER)
Month:
November
Year:
2021
Address:
Dominican Republic
Editors:
Rami Aly, Christos Christodoulopoulos, Oana Cocarascu, Zhijiang Guo, Arpit Mittal, Michael Schlichtkrull, James Thorne, Andreas Vlachos
Venue:
FEVER
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
31–39
Language:
URL:
https://aclanthology.org/2021.fever-1.4
DOI:
10.18653/v1/2021.fever-1.4
Bibkey:
Cite (ACL):
Mostafa Bouziane, Hugo Perrin, Amine Sadeq, Thanh Nguyen, Aurélien Cluzeau, and Julien Mardas. 2021. FaBULOUS: Fact-checking Based on Understanding of Language Over Unstructured and Structured information. In Proceedings of the Fourth Workshop on Fact Extraction and VERification (FEVER), pages 31–39, Dominican Republic. Association for Computational Linguistics.
Cite (Informal):
FaBULOUS: Fact-checking Based on Understanding of Language Over Unstructured and Structured information (Bouziane et al., FEVER 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.fever-1.4.pdf
Video:
 https://aclanthology.org/2021.fever-1.4.mp4
Data
FEVEROUS