Using Masked Language Model Probabilities of Connectives for Stance Detection in English Discourse

Regina Stodden, Laura Kallmeyer, Lea Kawaletz, Heidrun Dorgeloh


Abstract
This paper introduces an approach which operationalizes the role of discourse connectives for detecting argument stance. Specifically, the study investigates the utility of masked language model probabilities of discourse connectives inserted between a claim and a premise that supports or attacks it. The research focuses on a range of connectives known to signal support or attack, such as because, but, so, or although. By employing a LightGBM classifier, the study reveals promising results in stance detection in English discourse. While the proposed system does not aim to outperform state-of-the-art architectures, the classification accuracy is surprisingly high, highlighting the potential of these features to enhance argument mining tasks, including stance detection.
Anthology ID:
2023.argmining-1.2
Volume:
Proceedings of the 10th Workshop on Argument Mining
Month:
December
Year:
2023
Address:
Singapore
Editors:
Milad Alshomary, Chung-Chi Chen, Smaranda Muresan, Joonsuk Park, Julia Romberg
Venues:
ArgMining | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
11–18
Language:
URL:
https://aclanthology.org/2023.argmining-1.2
DOI:
10.18653/v1/2023.argmining-1.2
Bibkey:
Cite (ACL):
Regina Stodden, Laura Kallmeyer, Lea Kawaletz, and Heidrun Dorgeloh. 2023. Using Masked Language Model Probabilities of Connectives for Stance Detection in English Discourse. In Proceedings of the 10th Workshop on Argument Mining, pages 11–18, Singapore. Association for Computational Linguistics.
Cite (Informal):
Using Masked Language Model Probabilities of Connectives for Stance Detection in English Discourse (Stodden et al., ArgMining-WS 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.argmining-1.2.pdf