An In-depth Analysis of Implicit and Subtle Hate Speech Messages

Nicolás Benjamín Ocampo, Ekaterina Sviridova, Elena Cabrio, Serena Villata


Abstract
The research carried out so far in detecting abusive content in social media has primarily focused on overt forms of hate speech. While explicit hate speech (HS) is more easily identifiable by recognizing hateful words, messages containing linguistically subtle and implicit forms of HS (as circumlocution, metaphors and sarcasm) constitute a real challenge for automatic systems. While the sneaky and tricky nature of subtle messages might be perceived as less hurtful with respect to the same content expressed clearly, such abuse is at least as harmful as overt abuse. In this paper, we first provide an in-depth and systematic analysis of 7 standard benchmarks for HS detection, relying on a fine-grained and linguistically-grounded definition of implicit and subtle messages. Then, we experiment with state-of-the-art neural network architectures on two supervised tasks, namely implicit HS and subtle HS message classification. We show that while such models perform satisfactory on explicit messages, they fail to detect implicit and subtle content, highlighting the fact that HS detection is not a solved problem and deserves further investigation.
Anthology ID:
2023.eacl-main.147
Original:
2023.eacl-main.147v1
Version 2:
2023.eacl-main.147v2
Volume:
Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics
Month:
May
Year:
2023
Address:
Dubrovnik, Croatia
Editors:
Andreas Vlachos, Isabelle Augenstein
Venue:
EACL
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
1997–2013
Language:
URL:
https://aclanthology.org/2023.eacl-main.147
DOI:
10.18653/v1/2023.eacl-main.147
Bibkey:
Cite (ACL):
Nicolás Benjamín Ocampo, Ekaterina Sviridova, Elena Cabrio, and Serena Villata. 2023. An In-depth Analysis of Implicit and Subtle Hate Speech Messages. In Proceedings of the 17th Conference of the European Chapter of the Association for Computational Linguistics, pages 1997–2013, Dubrovnik, Croatia. Association for Computational Linguistics.
Cite (Informal):
An In-depth Analysis of Implicit and Subtle Hate Speech Messages (Ocampo et al., EACL 2023)
Copy Citation:
PDF:
https://aclanthology.org/2023.eacl-main.147.pdf
Video:
 https://aclanthology.org/2023.eacl-main.147.mp4