Automated Identification of Verbally Abusive Behaviors in Online Discussions

Srecko Joksimovic, Ryan S. Baker, Jaclyn Ocumpaugh, Juan Miguel L. Andres, Ivan Tot, Elle Yuan Wang, Shane Dawson


Abstract
Discussion forum participation represents one of the crucial factors for learning and often the only way of supporting social interactions in online settings. However, as much as sharing new ideas or asking thoughtful questions contributes learning, verbally abusive behaviors, such as expressing negative emotions in online discussions, could have disproportionate detrimental effects. To provide means for mitigating the potential negative effects on course participation and learning, we developed an automated classifier for identifying communication that show linguistic patterns associated with hostility in online forums. In so doing, we employ several well-established automated text analysis tools and build on the common practices for handling highly imbalanced datasets and reducing the sensitivity to overfitting. Although still in its infancy, our approach shows promising results (ROC AUC .73) towards establishing a robust detector of abusive behaviors. We further provide an overview of the classification (linguistic and contextual) features most indicative of online aggression.
Anthology ID:
W19-3505
Volume:
Proceedings of the Third Workshop on Abusive Language Online
Month:
August
Year:
2019
Address:
Florence, Italy
Editors:
Sarah T. Roberts, Joel Tetreault, Vinodkumar Prabhakaran, Zeerak Waseem
Venue:
ALW
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
36–45
Language:
URL:
https://aclanthology.org/W19-3505
DOI:
10.18653/v1/W19-3505
Bibkey:
Cite (ACL):
Srecko Joksimovic, Ryan S. Baker, Jaclyn Ocumpaugh, Juan Miguel L. Andres, Ivan Tot, Elle Yuan Wang, and Shane Dawson. 2019. Automated Identification of Verbally Abusive Behaviors in Online Discussions. In Proceedings of the Third Workshop on Abusive Language Online, pages 36–45, Florence, Italy. Association for Computational Linguistics.
Cite (Informal):
Automated Identification of Verbally Abusive Behaviors in Online Discussions (Joksimovic et al., ALW 2019)
Copy Citation:
PDF:
https://aclanthology.org/W19-3505.pdf