LCT-1 at SemEval-2023 Task 10: Pre-training and Multi-task Learning for Sexism Detection and Classification

Konstantin Chernyshev, Ekaterina Garanina, Duygu Bayram, Qiankun Zheng, Lukas Edman


Abstract
Misogyny and sexism are growing problems in social media. Advances have been made in online sexism detection but the systems are often uninterpretable. SemEval-2023 Task 10 on Explainable Detection of Online Sexism aims at increasing explainability of the sexism detection, and our team participated in all the proposed subtasks. Our system is based on further domain-adaptive pre-training. Building on the Transformer-based models with the domain adaptation, we compare fine-tuning with multi-task learning and show that each subtask requires a different system configuration. In our experiments, multi-task learning performs on par with standard fine-tuning for sexism detection and noticeably better for coarse-grained sexism classification, while fine-tuning is preferable for fine-grained classification.
Anthology ID:
2023.semeval-1.217
Volume:
Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023)
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Atul Kr. Ojha, A. Seza Doğruöz, Giovanni Da San Martino, Harish Tayyar Madabushi, Ritesh Kumar, Elisa Sartori
Venue:
SemEval
SIG:
SIGLEX
Publisher:
Association for Computational Linguistics
Note:
Pages:
1573–1581
Language:
URL:
https://aclanthology.org/2023.semeval-1.217
DOI:
10.18653/v1/2023.semeval-1.217
Bibkey:
Cite (ACL):
Konstantin Chernyshev, Ekaterina Garanina, Duygu Bayram, Qiankun Zheng, and Lukas Edman. 2023. LCT-1 at SemEval-2023 Task 10: Pre-training and Multi-task Learning for Sexism Detection and Classification. In Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023), pages 1573–1581, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
LCT-1 at SemEval-2023 Task 10: Pre-training and Multi-task Learning for Sexism Detection and Classification (Chernyshev et al., SemEval 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.semeval-1.217.pdf