DCU at SemEval-2023 Task 10: A Comparative Analysis of Encoder-only and Decoder-only Language Models with Insights into Interpretability

Kanishk Verma, Kolawole Adebayo, Joachim Wagner, Brian Davis


Abstract
We conduct a comparison of pre-trained encoder-only and decoder-only language models with and without continued pre-training, to detect online sexism. Our fine-tuning-based classifier system achieved the 16th rank in the SemEval 2023 Shared Task 10 Subtask A that asks to distinguish sexist and non-sexist texts. Additionally, we conduct experiments aimed at enhancing the interpretability of systems designed to detect online sexism. Our findings provide insights into the features and decision-making processes underlying our classifier system, thereby contributing to a broader effort to develop explainable AI models to detect online sexism.
Anthology ID:
2023.semeval-1.241
Volume:
Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023)
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Atul Kr. Ojha, A. Seza Doğruöz, Giovanni Da San Martino, Harish Tayyar Madabushi, Ritesh Kumar, Elisa Sartori
Venue:
SemEval
SIG:
SIGLEX
Publisher:
Association for Computational Linguistics
Note:
Pages:
1736–1750
Language:
URL:
https://aclanthology.org/2023.semeval-1.241
DOI:
10.18653/v1/2023.semeval-1.241
Bibkey:
Cite (ACL):
Kanishk Verma, Kolawole Adebayo, Joachim Wagner, and Brian Davis. 2023. DCU at SemEval-2023 Task 10: A Comparative Analysis of Encoder-only and Decoder-only Language Models with Insights into Interpretability. In Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023), pages 1736–1750, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
DCU at SemEval-2023 Task 10: A Comparative Analysis of Encoder-only and Decoder-only Language Models with Insights into Interpretability (Verma et al., SemEval 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.semeval-1.241.pdf
Video:
 https://aclanthology.org/2023.semeval-1.241.mp4