SubmissionNumber#=%=#93
FinalPaperTitle#=%=#OtterlyObsessedWithSemantics at SemEval-2024 Task 4: Developing a Hierarchical Multi-Label Classification Head for Large Language Models
ShortPaperTitle#=%=#
NumberOfPages#=%=#11
CopyrightSigned#=%=#Julia Wunderle
JobTitle#==#
Organization#==#Julius-Maximilians-Universität Würzburg
Postanschrift: Sanderring 2, 97070 Würzburg
Abstract#==#For our submission for Subtask 1, we developed a custom classification head that is designed to be applied atop of a Large Language Model. 
We reconstructed the hierarchy across multiple fully connected layers, allowing us to incorporate previous foundational decisions in subsequent, more fine-grained layers. To find  the best hyperparameters, we conducted a grid-search and to compete in the multilingual setting, we translated all documents to English.
Author{1}{Firstname}#=%=#Julia
Author{1}{Lastname}#=%=#Wunderle
Author{1}{Username}#=%=#juliawunderle
Author{1}{Email}#=%=#wunderle@informatik.uni-wuerzburg.de
Author{1}{Affiliation}#=%=#University of Wuerzburg
Author{2}{Firstname}#=%=#Julian
Author{2}{Lastname}#=%=#Schubert
Author{2}{Username}#=%=#julianschubert
Author{2}{Email}#=%=#informatik.schubert@gmail.com
Author{2}{Affiliation}#=%=#University of Wuerzburg
Author{3}{Firstname}#=%=#Antonella
Author{3}{Lastname}#=%=#Cacciatore
Author{3}{Username}#=%=#antonella.cacciatore
Author{3}{Email}#=%=#antonella.cacciatore@stud-mail.uni-wuerzburg.de
Author{3}{Affiliation}#=%=#Julius-Maximilians-Universitaet Wuerzburg
Author{4}{Firstname}#=%=#Albin
Author{4}{Lastname}#=%=#Zehe
Author{4}{Username}#=%=#albinzehe
Author{4}{Email}#=%=#zehe@informatik.uni-wuerzburg.de
Author{4}{Affiliation}#=%=#University of Wuerzburg
Author{5}{Firstname}#=%=#Jan
Author{5}{Lastname}#=%=#Pfister
Author{5}{Username}#=%=#janpf
Author{5}{Email}#=%=#pfister@informatik.uni-wuerzburg.de
Author{5}{Affiliation}#=%=#Julius-Maximilians-Universität Würzburg (JMU)
Author{6}{Firstname}#=%=#Andreas
Author{6}{Lastname}#=%=#Hotho
Author{6}{Username}#=%=#hotho
Author{6}{Email}#=%=#hotho@informatik.uni-wuerzburg.de
Author{6}{Affiliation}#=%=#University of Würzburg

==========
èéáğö