Resources for Multilingual Hate Speech Detection

Ayme Arango Monnar, Jorge Perez, Barbara Poblete, Magdalena Saldaña, Valentina Proust


Abstract
Most of the published approaches and resources for hate speech detection are tailored for the English language. In consequence, cross-lingual and cross-cultural perspectives lack some essential resources. The lack of diversity of the datasets in Spanish is notable. Variations throughout Spanish-speaking countries make existing datasets not enough to encompass the task in the different Spanish variants. We annotated 9834 tweets from Chile to enrich the existing Spanish resources with different words and new targets of hate that have not been considered in previous studies. We conducted several cross-dataset evaluation experiments of the models published in the literature using our Chilean dataset and two others in English and Spanish. We propose a comparative framework for quickly conducting comparative experiments using different previously published models. In addition, we set up a Codalab competition for further comparison of new models in a standard scenario, that is, data partitions and evaluation metrics. All resources can be accessed trough a centralized repository for researchers to get a complete picture of the progress on the multilingual hate speech and offensive language detection task.
Anthology ID:
2022.woah-1.12
Volume:
Proceedings of the Sixth Workshop on Online Abuse and Harms (WOAH)
Month:
July
Year:
2022
Address:
Seattle, Washington (Hybrid)
Editors:
Kanika Narang, Aida Mostafazadeh Davani, Lambert Mathias, Bertie Vidgen, Zeerak Talat
Venue:
WOAH
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
122–130
Language:
URL:
https://aclanthology.org/2022.woah-1.12
DOI:
10.18653/v1/2022.woah-1.12
Bibkey:
Cite (ACL):
Ayme Arango Monnar, Jorge Perez, Barbara Poblete, Magdalena Saldaña, and Valentina Proust. 2022. Resources for Multilingual Hate Speech Detection. In Proceedings of the Sixth Workshop on Online Abuse and Harms (WOAH), pages 122–130, Seattle, Washington (Hybrid). Association for Computational Linguistics.
Cite (Informal):
Resources for Multilingual Hate Speech Detection (Arango Monnar et al., WOAH 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.woah-1.12.pdf
Video:
 https://aclanthology.org/2022.woah-1.12.mp4