Julian Schubert
2024
OtterlyObsessedWithSemantics at SemEval-2024 Task 4: Developing a Hierarchical Multi-Label Classification Head for Large Language Models
Julia Wunderle
|
Julian Schubert
|
Antonella Cacciatore
|
Albin Zehe
|
Jan Pfister
|
Andreas Hotho
Proceedings of the 18th International Workshop on Semantic Evaluation (SemEval-2024)
For our submission for Subtask 1, we developed a custom classification head that is designed to be applied atop of a Large Language Model. We reconstructed the hierarchy across multiple fully connected layers, allowing us to incorporate previous foundational decisions in subsequent, more fine-grained layers. To find the best hyperparameters, we conducted a grid-search and to compete in the multilingual setting, we translated all documents to English.
Search