Overview of PerpectiveArg2024 The First Shared Task on Perspective Argument Retrieval

Neele Falk, Andreas Waldis, Iryna Gurevych


Abstract
Argument retrieval is the task of finding relevant arguments for a given query. While existing approaches rely solely on the semantic alignment of queries and arguments, this first shared task on perspective argument retrieval incorporates perspectives during retrieval, ac- counting for latent influences in argumenta- tion. We present a novel multilingual dataset covering demographic and socio-cultural (so- cio) variables, such as age, gender, and politi- cal attitude, representing minority and major- ity groups in society. We distinguish between three scenarios to explore how retrieval systems consider explicitly (in both query and corpus) and implicitly (only in query) formulated per- spectives. This paper provides an overview of this shared task and summarizes the results of the six submitted systems. We find substantial challenges in incorporating perspectivism, especially when aiming for personalization based solely on the text of arguments without explicitly providing socio profiles. Moreover, re- trieval systems tend to be biased towards the majority group but partially mitigate bias for the female gender. While we bootstrap per- spective argument retrieval, further research is essential to optimize retrieval systems to facilitate personalization and reduce polarization.
Anthology ID:
2024.argmining-1.14
Volume:
Proceedings of the 11th Workshop on Argument Mining (ArgMining 2024)
Month:
August
Year:
2024
Address:
Bangkok, Thailand
Editors:
Yamen Ajjour, Roy Bar-Haim, Roxanne El Baff, Zhexiong Liu, Gabriella Skitalinskaya
Venue:
ArgMining
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
130–149
Language:
URL:
https://aclanthology.org/2024.argmining-1.14
DOI:
Bibkey:
Cite (ACL):
Neele Falk, Andreas Waldis, and Iryna Gurevych. 2024. Overview of PerpectiveArg2024 The First Shared Task on Perspective Argument Retrieval. In Proceedings of the 11th Workshop on Argument Mining (ArgMining 2024), pages 130–149, Bangkok, Thailand. Association for Computational Linguistics.
Cite (Informal):
Overview of PerpectiveArg2024 The First Shared Task on Perspective Argument Retrieval (Falk et al., ArgMining 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.argmining-1.14.pdf