Overview of DialAM-2024: Argument Mining in Natural Language Dialogues

Ramon Ruiz-Dolz, John Lawrence, Ella Schad, Chris Reed


Abstract
Argumentation is the process by which humans rationally elaborate their thoughts and opinions in written (e.g., essays) or spoken (e.g., debates) contexts. Argument Mining research, however, has been focused on either written argumentation or spoken argumentation but without considering any additional information, e.g., speech acts and intentions. In this paper, we present an overview of DialAM-2024, the first shared task in dialogical argument mining, where argumentative relations and speech illocutions are modelled together in a unified framework. The task was divided into two different sub-tasks: the identification of propositional relations and the identification of illocutionary relations. Six different teams explored different methodologies to leverage both sources of information to reconstruct argument maps containing the locutions uttered in the speeches and the argumentative propositions implicit in them. The best performing team achieved an F1-score of 67.05% in the overall evaluation of the reconstruction of complete argument maps, considering both sub-tasks included in the DialAM-2024 shared task.
Anthology ID:
2024.argmining-1.8
Volume:
Proceedings of the 11th Workshop on Argument Mining (ArgMining 2024)
Month:
August
Year:
2024
Address:
Bangkok, Thailand
Editors:
Yamen Ajjour, Roy Bar-Haim, Roxanne El Baff, Zhexiong Liu, Gabriella Skitalinskaya
Venue:
ArgMining
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
83–92
Language:
URL:
https://aclanthology.org/2024.argmining-1.8
DOI:
10.18653/v1/2024.argmining-1.8
Bibkey:
Cite (ACL):
Ramon Ruiz-Dolz, John Lawrence, Ella Schad, and Chris Reed. 2024. Overview of DialAM-2024: Argument Mining in Natural Language Dialogues. In Proceedings of the 11th Workshop on Argument Mining (ArgMining 2024), pages 83–92, Bangkok, Thailand. Association for Computational Linguistics.
Cite (Informal):
Overview of DialAM-2024: Argument Mining in Natural Language Dialogues (Ruiz-Dolz et al., ArgMining 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.argmining-1.8.pdf