Aristoxenus at SemEval-2023 Task 4: A Domain-Adapted Ensemble Approach to the Identification of Human Values behind Arguments

Dimitrios Zaikis, Stefanos D. Stefanidis, Konstantinos Anagnostopoulos, Ioannis Vlahavas


Abstract
This paper presents our system for the SemEval-2023 Task 4, which aims to identify human values behind arguments by classifying whether or not an argument draws on a specific category. Our approach leverages a second-phase pre-training method to adapt a RoBERTa Language Model (LM) and tackles the problem using a One-Versus-All strategy. Final predictions are determined by a majority voting module that combines the outputs of an ensemble of three sets of per-label models. We conducted experiments to evaluate the impact of different pre-trained LMs on the task, comparing their performance in both pre-trained and task-adapted settings. Our findings show that fine-tuning the RoBERTa LM on the task-specific dataset improves its performance, outperforming the best-performing baseline BERT approach. Overall, our approach achieved a macro-F1 score of 0.47 on the official test set, demonstrating its potential in identifying human values behind arguments.
Anthology ID:
2023.semeval-1.142
Volume:
Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023)
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Atul Kr. Ojha, A. Seza Doğruöz, Giovanni Da San Martino, Harish Tayyar Madabushi, Ritesh Kumar, Elisa Sartori
Venue:
SemEval
SIG:
SIGLEX
Publisher:
Association for Computational Linguistics
Note:
Pages:
1037–1043
Language:
URL:
https://aclanthology.org/2023.semeval-1.142
DOI:
10.18653/v1/2023.semeval-1.142
Bibkey:
Cite (ACL):
Dimitrios Zaikis, Stefanos D. Stefanidis, Konstantinos Anagnostopoulos, and Ioannis Vlahavas. 2023. Aristoxenus at SemEval-2023 Task 4: A Domain-Adapted Ensemble Approach to the Identification of Human Values behind Arguments. In Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023), pages 1037–1043, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
Aristoxenus at SemEval-2023 Task 4: A Domain-Adapted Ensemble Approach to the Identification of Human Values behind Arguments (Zaikis et al., SemEval 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.semeval-1.142.pdf