John-Arthur at SemEval-2023 Task 4: Fine-Tuning Large Language Models for Arguments Classification

Georgios Balikas


Abstract
This paper presents the system submissions of the John-Arthur team to the SemEval Task 4 “ValueEval: Identification of Human Values behind Arguments”. The best system of the team was ranked 3rd and the overall rank of the team was 2nd (the first team had the two best systems). John-Arthur team models the ValueEval problem as a multi-class, multi-label text classification problem. The solutions leverage recently proposed large language models that are fine-tuned on the provided datasets. To boost the achieved performance we employ different best practises whose impact on the model performance we evaluate here. The code ispublicly available at github and the model onHuggingface hub.
Anthology ID:
2023.semeval-1.197
Volume:
Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023)
Month:
July
Year:
2023
Address:
Toronto, Canada
Editors:
Atul Kr. Ojha, A. Seza Doğruöz, Giovanni Da San Martino, Harish Tayyar Madabushi, Ritesh Kumar, Elisa Sartori
Venue:
SemEval
SIG:
SIGLEX
Publisher:
Association for Computational Linguistics
Note:
Pages:
1428–1432
Language:
URL:
https://aclanthology.org/2023.semeval-1.197
DOI:
10.18653/v1/2023.semeval-1.197
Bibkey:
Cite (ACL):
Georgios Balikas. 2023. John-Arthur at SemEval-2023 Task 4: Fine-Tuning Large Language Models for Arguments Classification. In Proceedings of the 17th International Workshop on Semantic Evaluation (SemEval-2023), pages 1428–1432, Toronto, Canada. Association for Computational Linguistics.
Cite (Informal):
John-Arthur at SemEval-2023 Task 4: Fine-Tuning Large Language Models for Arguments Classification (Balikas, SemEval 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.semeval-1.197.pdf