BreakingBERT@IITK at SemEval-2021 Task 9: Statement Verification and Evidence Finding with Tables

Aditya Jindal, Ankur Gupta, Jaya Srivastava, Preeti Menghwani, Vijit Malik, Vishesh Kaushik, Ashutosh Modi


Abstract
Recently, there has been an interest in the research on factual verification and prediction over structured data like tables and graphs. To circumvent any false news incident, it is necessary to not only model and predict over structured data efficiently but also to explain those predictions. In this paper, as the part of the SemEval-2021 Task 9, we tackle the problem of fact verification and evidence finding over tabular data. There are two subtasks, in which given a table and a statement/fact, the subtask A is to determine whether the statement is inferred from the tabular data and the subtask B is to determine which cells in the table provide evidence for the former subtask. We make a comparison of the baselines and state of the art approaches over the given SemTabFact dataset. We also propose a novel approach CellBERT to solve the task of evidence finding, as a form of Natural Language Inference task. We obtain a 3-way F1 score of 0.69 on subtask A and an F1 score of 0.65 on subtask B.
Anthology ID:
2021.semeval-1.40
Volume:
Proceedings of the 15th International Workshop on Semantic Evaluation (SemEval-2021)
Month:
August
Year:
2021
Address:
Online
Editors:
Alexis Palmer, Nathan Schneider, Natalie Schluter, Guy Emerson, Aurelie Herbelot, Xiaodan Zhu
Venue:
SemEval
SIG:
SIGLEX
Publisher:
Association for Computational Linguistics
Note:
Pages:
327–337
Language:
URL:
https://aclanthology.org/2021.semeval-1.40
DOI:
10.18653/v1/2021.semeval-1.40
Bibkey:
Cite (ACL):
Aditya Jindal, Ankur Gupta, Jaya Srivastava, Preeti Menghwani, Vijit Malik, Vishesh Kaushik, and Ashutosh Modi. 2021. BreakingBERT@IITK at SemEval-2021 Task 9: Statement Verification and Evidence Finding with Tables. In Proceedings of the 15th International Workshop on Semantic Evaluation (SemEval-2021), pages 327–337, Online. Association for Computational Linguistics.
Cite (Informal):
BreakingBERT@IITK at SemEval-2021 Task 9: Statement Verification and Evidence Finding with Tables (Jindal et al., SemEval 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.semeval-1.40.pdf
Video:
 https://aclanthology.org/2021.semeval-1.40.mp4
Data
TabFact