Automated Detection of Cyberbullying Against Women and Immigrants and Cross-domain Adaptability

Thushari Atapattu, Mahen Herath, Georgia Zhang, Katrina Falkner


Abstract
Cyberbullying is a prevalent and growing social problem due to the surge of social media technology usage. Minorities, women, and adolescents are among the common victims of cyberbullying. Despite the advancement of NLP technologies, the automated cyberbullying detection remains challenging. This paper focuses on advancing the technology using state-of-the-art NLP techniques. We use a Twitter dataset from SemEval 2019 - Task 5 (HatEval) on hate speech against women and immigrants. Our best performing ensemble model based on DistiBERT has achieved 0.73 and 0.74 of F1 score in the task of classifying hate speech (Task A) and aggressiveness and target (Task B) respectively. We adapt the ensemble model developed for Task A to classify offensive language in external datasets and achieved ~0.7 of F1 score using three benchmark datasets, enabling promising results for cross-domain adaptability. We conduct a qualitative analysis of misclassified tweets to provide insightful recommendations for future cyberbullying research.
Anthology ID:
2020.alta-1.2
Volume:
Proceedings of the 18th Annual Workshop of the Australasian Language Technology Association
Month:
December
Year:
2020
Address:
Virtual Workshop
Editors:
Maria Kim, Daniel Beck, Meladel Mistica
Venue:
ALTA
SIG:
Publisher:
Australasian Language Technology Association
Note:
Pages:
11–20
Language:
URL:
https://aclanthology.org/2020.alta-1.2
DOI:
Bibkey:
Cite (ACL):
Thushari Atapattu, Mahen Herath, Georgia Zhang, and Katrina Falkner. 2020. Automated Detection of Cyberbullying Against Women and Immigrants and Cross-domain Adaptability. In Proceedings of the 18th Annual Workshop of the Australasian Language Technology Association, pages 11–20, Virtual Workshop. Australasian Language Technology Association.
Cite (Informal):
Automated Detection of Cyberbullying Against Women and Immigrants and Cross-domain Adaptability (Atapattu et al., ALTA 2020)
Copy Citation:
PDF:
https://aclanthology.org/2020.alta-1.2.pdf