BYteam at SemEval-2020 Task 5: Detecting Counterfactual Statements with BERT and Ensembles

Yang Bai, Xiaobing Zhou


Abstract
We participate in the classification tasks of SemEval-2020 Task: Subtask1: Detecting counterfactual statements of semeval-2020 task5(Detecting Counterfactuals). This paper examines different approaches and models towards detecting counterfactual statements classification. We choose the Bert model. However, the output of Bert is not a good summary of semantic information, so in order to obtain more abundant semantic information features, we modify the upper layer structure of Bert. Finally, our system achieves an accuracy of 88.90% and F1 score of 86.30% by hard voting, which ranks 6th on the final leader board of the in subtask 1 competition.
Anthology ID:
2020.semeval-1.82
Volume:
Proceedings of the Fourteenth Workshop on Semantic Evaluation
Month:
December
Year:
2020
Address:
Barcelona (online)
Editors:
Aurelie Herbelot, Xiaodan Zhu, Alexis Palmer, Nathan Schneider, Jonathan May, Ekaterina Shutova
Venue:
SemEval
SIG:
SIGLEX
Publisher:
International Committee for Computational Linguistics
Note:
Pages:
640–644
Language:
URL:
https://aclanthology.org/2020.semeval-1.82
DOI:
10.18653/v1/2020.semeval-1.82
Bibkey:
Cite (ACL):
Yang Bai and Xiaobing Zhou. 2020. BYteam at SemEval-2020 Task 5: Detecting Counterfactual Statements with BERT and Ensembles. In Proceedings of the Fourteenth Workshop on Semantic Evaluation, pages 640–644, Barcelona (online). International Committee for Computational Linguistics.
Cite (Informal):
BYteam at SemEval-2020 Task 5: Detecting Counterfactual Statements with BERT and Ensembles (Bai & Zhou, SemEval 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.semeval-1.82.pdf