Sövereign at The Perspective Argument Retrieval Shared Task 2024: Using LLMs with Argument Mining

Robert Günzler, Özge Sevgili, Steffen Remus, Chris Biemann, Irina Nikishina


Abstract
This paper presents the Sövereign submission for the shared task on perspective argument retrieval for the Argument Mining Workshop 2024. The main challenge is to perform argument retrieval considering socio-cultural aspects such as political interests, occupation, age, and gender. To address the challenge, we apply open-access Large Language Models (Mistral-7b) in a zero-shot fashion for re-ranking and explicit similarity scoring. Additionally, we combine different features in an ensemble setup using logistic regression. Our system ranks second in the competition for all test set rounds on average for the logistic regression approach using LLM similarity scores as a feature. In addition to the description of the approach, we also provide further results of our ablation study. Our code will be open-sourced upon acceptance.
Anthology ID:
2024.argmining-1.15
Volume:
Proceedings of the 11th Workshop on Argument Mining (ArgMining 2024)
Month:
August
Year:
2024
Address:
Bangkok, Thailand
Editors:
Yamen Ajjour, Roy Bar-Haim, Roxanne El Baff, Zhexiong Liu, Gabriella Skitalinskaya
Venue:
ArgMining
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
150–158
Language:
URL:
https://aclanthology.org/2024.argmining-1.15
DOI:
Bibkey:
Cite (ACL):
Robert Günzler, Özge Sevgili, Steffen Remus, Chris Biemann, and Irina Nikishina. 2024. Sövereign at The Perspective Argument Retrieval Shared Task 2024: Using LLMs with Argument Mining. In Proceedings of the 11th Workshop on Argument Mining (ArgMining 2024), pages 150–158, Bangkok, Thailand. Association for Computational Linguistics.
Cite (Informal):
Sövereign at The Perspective Argument Retrieval Shared Task 2024: Using LLMs with Argument Mining (Günzler et al., ArgMining 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.argmining-1.15.pdf