Agreement Prediction of Arguments in Cyber Argumentation for Detecting Stance Polarity and Intensity

Joseph Sirrianni, Xiaoqing Liu, Douglas Adams


Abstract
In online debates, users express different levels of agreement/disagreement with one another’s arguments and ideas. Often levels of agreement/disagreement are implicit in the text, and must be predicted to analyze collective opinions. Existing stance detection methods predict the polarity of a post’s stance toward a topic or post, but don’t consider the stance’s degree of intensity. We introduce a new research problem, stance polarity and intensity prediction in response relationships between posts. This problem is challenging because differences in stance intensity are often subtle and require nuanced language understanding. Cyber argumentation research has shown that incorporating both stance polarity and intensity data in online debates leads to better discussion analysis. We explore five different learning models: Ridge-M regression, Ridge-S regression, SVR-RF-R, pkudblab-PIP, and T-PAN-PIP for predicting stance polarity and intensity in argumentation. These models are evaluated using a new dataset for stance polarity and intensity prediction collected using a cyber argumentation platform. The SVR-RF-R model performs best for prediction of stance polarity with an accuracy of 70.43% and intensity with RMSE of 0.596. This work is the first to train models for predicting a post’s stance polarity and intensity in one combined value in cyber argumentation with reasonably good accuracy.
Anthology ID:
2020.acl-main.509
Volume:
Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics
Month:
July
Year:
2020
Address:
Online
Editors:
Dan Jurafsky, Joyce Chai, Natalie Schluter, Joel Tetreault
Venue:
ACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
5746–5758
Language:
URL:
https://aclanthology.org/2020.acl-main.509
DOI:
10.18653/v1/2020.acl-main.509
Bibkey:
Cite (ACL):
Joseph Sirrianni, Xiaoqing Liu, and Douglas Adams. 2020. Agreement Prediction of Arguments in Cyber Argumentation for Detecting Stance Polarity and Intensity. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, pages 5746–5758, Online. Association for Computational Linguistics.
Cite (Informal):
Agreement Prediction of Arguments in Cyber Argumentation for Detecting Stance Polarity and Intensity (Sirrianni et al., ACL 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.acl-main.509.pdf
Video:
 http://slideslive.com/38929179