UIRISC at SemEval-2023 Task 10: Explainable Detection of Online Sexism by Ensembling Fine-tuning Language Models

Tianyun Zhong, Runhui Song, Xunyuan Liu, Juelin Wang, Boya Wang, Binyang Li


Abstract
Under the umbrella of anonymous social networks, many women have suffered from abuse, discrimination, and other sexist expressions online. However, exsiting methods based on keyword filtering and matching performed poorly on online sexism detection, which lacked the capability to identify implicit stereotypes and discrimination. Therefore, this paper proposes a System of Ensembling Fine-tuning Models (SEFM) at SemEval-2023 Task 10: Explainable Detection of Online Sexism. We firstly use four task-adaptive pre-trained language models to flag all texts. Secondly, we alleviate the data imbalance from two perspectives: over-sampling the labelled data and adjusting the loss function. Thirdly, we add indicators and feedback modules to enhance the overall performance. Our system attained macro F1 scores of 0.8538, 0.6619, and 0.4641 for Subtask A, B, and C, respectively. Our system exhibited strong performance across multiple tasks, with particularly noteworthy performance in Subtask B. Comparison experiments and ablation studies demonstrate the effectiveness of our system.
Anthology ID:
2023.semeval-1.287
Volume:
Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023)
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Atul Kr. Ojha, A. Seza Doğruöz, Giovanni Da San Martino, Harish Tayyar Madabushi, Ritesh Kumar, Elisa Sartori
Venue:
SemEval
SIG:
SIGLEX
Publisher:
Association for Computational Linguistics
Note:
Pages:
2082–2090
Language:
URL:
https://aclanthology.org/2023.semeval-1.287
DOI:
10.18653/v1/2023.semeval-1.287
Bibkey:
Cite (ACL):
Tianyun Zhong, Runhui Song, Xunyuan Liu, Juelin Wang, Boya Wang, and Binyang Li. 2023. UIRISC at SemEval-2023 Task 10: Explainable Detection of Online Sexism by Ensembling Fine-tuning Language Models. In Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023), pages 2082–2090, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
UIRISC at SemEval-2023 Task 10: Explainable Detection of Online Sexism by Ensembling Fine-tuning Language Models (Zhong et al., SemEval 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.semeval-1.287.pdf
Video:
 https://aclanthology.org/2023.semeval-1.287.mp4