Attention at SemEval-2023 Task 10: Explainable Detection of Online Sexism (EDOS)

Debashish Roy, Manish Shrivastava


Abstract
In this paper, we have worked on explainability and understanding of the decisions made by models in the form of classification tasks. The task is divided into 3 subtasks. The first task consists of determining Binary Sexism Detection. The second task describes the Category of Sexism. The third task describes a more Fine-grained Category of Sexism. Our work explores solving these tasks as a classification problem by fine-tuning transformer-based architecture. We have performed several experiments with our architecture, including combining multiple transformers, using domain adaptive pretraining on the unlabelled dataset provided by Reddit and Gab, Joint learning, and taking different layers of transformers as input to a classification head. Our system (with the team name Attention’) was able to achieve a macro F1 score of 0.839 for task A, 0.5835 macro F1 score for task B and 0.3356 macro F1 score for task C at the Codalab SemEval Competition. Later we improved the accuracy of Task B to 0.6228 and Task C to 0.3693 in the test set.
Anthology ID:
2023.semeval-1.271
Volume:
Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023)
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Atul Kr. Ojha, A. Seza Doğruöz, Giovanni Da San Martino, Harish Tayyar Madabushi, Ritesh Kumar, Elisa Sartori
Venue:
SemEval
SIG:
SIGLEX
Publisher:
Association for Computational Linguistics
Note:
Pages:
1972–1977
Language:
URL:
https://aclanthology.org/2023.semeval-1.271
DOI:
10.18653/v1/2023.semeval-1.271
Bibkey:
Cite (ACL):
Debashish Roy and Manish Shrivastava. 2023. Attention at SemEval-2023 Task 10: Explainable Detection of Online Sexism (EDOS). In Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023), pages 1972–1977, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
Attention at SemEval-2023 Task 10: Explainable Detection of Online Sexism (EDOS) (Roy & Shrivastava, SemEval 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.semeval-1.271.pdf