A Large-Scale English Multi-Label Twitter Dataset for Cyberbullying and Online Abuse Detection

Semiu Salawu, Jo Lumsden, Yulan He


Abstract
In this paper, we introduce a new English Twitter-based dataset for cyberbullying detection and online abuse. Comprising 62,587 tweets, this dataset was sourced from Twitter using specific query terms designed to retrieve tweets with high probabilities of various forms of bullying and offensive content, including insult, trolling, profanity, sarcasm, threat, porn and exclusion. We recruited a pool of 17 annotators to perform fine-grained annotation on the dataset with each tweet annotated by three annotators. All our annotators are high school educated and frequent users of social media. Inter-rater agreement for the dataset as measured by Krippendorff’s Alpha is 0.67. Analysis performed on the dataset confirmed common cyberbullying themes reported by other studies and revealed interesting relationships between the classes. The dataset was used to train a number of transformer-based deep learning models returning impressive results.
Anthology ID:
2021.woah-1.16
Volume:
Proceedings of the 5th Workshop on Online Abuse and Harms (WOAH 2021)
Month:
August
Year:
2021
Address:
Online
Editors:
Aida Mostafazadeh Davani, Douwe Kiela, Mathias Lambert, Bertie Vidgen, Vinodkumar Prabhakaran, Zeerak Waseem
Venue:
WOAH
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
146–156
Language:
URL:
https://aclanthology.org/2021.woah-1.16
DOI:
10.18653/v1/2021.woah-1.16
Bibkey:
Cite (ACL):
Semiu Salawu, Jo Lumsden, and Yulan He. 2021. A Large-Scale English Multi-Label Twitter Dataset for Cyberbullying and Online Abuse Detection. In Proceedings of the 5th Workshop on Online Abuse and Harms (WOAH 2021), pages 146–156, Online. Association for Computational Linguistics.
Cite (Informal):
A Large-Scale English Multi-Label Twitter Dataset for Cyberbullying and Online Abuse Detection (Salawu et al., WOAH 2021)
Copy Citation:
PDF:
https://aclanthology.org/2021.woah-1.16.pdf