Stanford MLab at SemEval-2023 Task 10: Exploring GloVe- and Transformer-Based Methods for the Explainable Detection of Online Sexism

Aaron Wan, Hong Meng Yam, Swetha Yogeswaran, Beining Zhou, Hee Jung Choi, Trevor Chow


Abstract
In this paper, we discuss the methods we applied at SemEval-2023 Task 10: Towards the Explainable Detection of Online Sexism. Given an input text, we perform three classification tasks to predict whether the text is sexist and classify the sexist text into subcategories in order to provide an additional explanation as to why the text is sexist. We explored many different types of models, including GloVe embeddings as the baseline approach, transformer-based deep learning models like BERT, RoBERTa, and DeBERTa, ensemble models, and model blending. We explored various data cleaning and augmentation methods to improve model performance. Pre-training transformer models yielded significant improvements in performance, and ensembles and blending slightly improved robustness in the F1 score.
Anthology ID:
2023.semeval-1.248
Volume:
Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023)
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Atul Kr. Ojha, A. Seza Doğruöz, Giovanni Da San Martino, Harish Tayyar Madabushi, Ritesh Kumar, Elisa Sartori
Venue:
SemEval
SIG:
SIGLEX
Publisher:
Association for Computational Linguistics
Note:
Pages:
1791–1797
Language:
URL:
https://aclanthology.org/2023.semeval-1.248
DOI:
10.18653/v1/2023.semeval-1.248
Bibkey:
Cite (ACL):
Aaron Wan, Hong Meng Yam, Swetha Yogeswaran, Beining Zhou, Hee Jung Choi, and Trevor Chow. 2023. Stanford MLab at SemEval-2023 Task 10: Exploring GloVe- and Transformer-Based Methods for the Explainable Detection of Online Sexism. In Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023), pages 1791–1797, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
Stanford MLab at SemEval-2023 Task 10: Exploring GloVe- and Transformer-Based Methods for the Explainable Detection of Online Sexism (Wan et al., SemEval 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.semeval-1.248.pdf