Computational Modelling of Undercuts in Real-world Arguments

Yuxiao Ye, Simone Teufel


Abstract
Argument Mining (AM) is the task of automatically analysing arguments, such that the unstructured information contained in them is converted into structured representations. Undercut is a unique structure in arguments, as it challenges the relationship between a premise and a claim, unlike direct attacks which challenge the claim or the premise itself. Undercut is also an important counterargument device as it often reflects the value of arguers. However, undercuts have not received the attention in the filed of AM they should have — there is neither much corpus data about undercuts, nor an existing AM model that can automatically recognise them. In this paper, we present a real-world dataset of arguments with explicitly annotated undercuts, and the first computational model that is able to recognise them. The dataset consists of 400 arguments, containing 326 undercuts. On this dataset, our approach beats a strong baseline in undercut recognition, with F1 = 38.8%, which is comparable to the performance on recognising direct attacks. We also conduct experiments on a benchmark dataset containing no undercuts, and prove that our approach is as good as the state of the art in terms of recognising the overall structure of arguments. Our work pioneers the systematic analysis and computational modelling of undercuts in real-world arguments, setting a foundation for future research in the role of undercuts in the dynamics of argumentation.
Anthology ID:
2024.argmining-1.6
Volume:
Proceedings of the 11th Workshop on Argument Mining (ArgMining 2024)
Month:
August
Year:
2024
Address:
Bangkok, Thailand
Editors:
Yamen Ajjour, Roy Bar-Haim, Roxanne El Baff, Zhexiong Liu, Gabriella Skitalinskaya
Venue:
ArgMining
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
59–68
Language:
URL:
https://aclanthology.org/2024.argmining-1.6
DOI:
Bibkey:
Cite (ACL):
Yuxiao Ye and Simone Teufel. 2024. Computational Modelling of Undercuts in Real-world Arguments. In Proceedings of the 11th Workshop on Argument Mining (ArgMining 2024), pages 59–68, Bangkok, Thailand. Association for Computational Linguistics.
Cite (Informal):
Computational Modelling of Undercuts in Real-world Arguments (Ye & Teufel, ArgMining 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.argmining-1.6.pdf