Finnish Hate-Speech Detection on Social Media Using CNN and FinBERT

Md Saroar Jahan, Mourad Oussalah, Nabil Arhab


Abstract
There has been a lot of research in identifying hate posts from social media because of their detrimental effects on both individuals and society. The majority of this research has concentrated on English, although one notices the emergence of multilingual detection tools such as multilingual-BERT (mBERT). However, there is a lack of hate speech datasets compared to English, and a multilingual pre-trained model often contains fewer tokens for other languages. This paper attempts to contribute to hate speech identification in Finnish by constructing a new hate speech dataset that is collected from a popular forum (Suomi24). Furthermore, we have experimented with FinBERT pre-trained model performance for Finnish hate speech detection compared to state-of-the-art mBERT and other practices. In addition, we tested the performance of FinBERT compared to fastText as embedding, which employed with Convolution Neural Network (CNN). Our results showed that FinBERT yields a 91.7% accuracy and 90.8% F1 score value, which outperforms all state-of-art models, including multilingual-BERT and CNN.
Anthology ID:
2022.lrec-1.92
Volume:
Proceedings of the Thirteenth Language Resources and Evaluation Conference
Month:
June
Year:
2022
Address:
Marseille, France
Editors:
Nicoletta Calzolari, Frédéric Béchet, Philippe Blache, Khalid Choukri, Christopher Cieri, Thierry Declerck, Sara Goggi, Hitoshi Isahara, Bente Maegaard, Joseph Mariani, Hélène Mazo, Jan Odijk, Stelios Piperidis
Venue:
LREC
SIG:
Publisher:
European Language Resources Association
Note:
Pages:
876–882
Language:
URL:
https://aclanthology.org/2022.lrec-1.92
DOI:
Bibkey:
Cite (ACL):
Md Saroar Jahan, Mourad Oussalah, and Nabil Arhab. 2022. Finnish Hate-Speech Detection on Social Media Using CNN and FinBERT. In Proceedings of the Thirteenth Language Resources and Evaluation Conference, pages 876–882, Marseille, France. European Language Resources Association.
Cite (Informal):
Finnish Hate-Speech Detection on Social Media Using CNN and FinBERT (Jahan et al., LREC 2022)
Copy Citation:
PDF:
https://aclanthology.org/2022.lrec-1.92.pdf