Detecting Hate Speech and Fake Narratives in Code-Mixed Hinglish Social Media Text

Advaitha Vetagiri, Partha Pakray


Abstract
The increasing prevalence of hate speech and fake narratives on social media platforms posessignificant societal challenges. This study ad-dresses these issues through the developmentof robust machine learning models for twotasks: (1) detecting hate speech and fake nar-ratives (Task A) and (2) predicting the targetand severity of hateful content (Task B) incode-mixed Hindi-English text. We proposefour separate CNN-BiLSTM models tailoredfor each subtask. The models were evaluatedusing validation and 5-fold cross-validationdatasets, achieving F1-scores of 74% and 79%for hate and fake detection, respectively, and63% and 54% for target and severity predic-tion and achieved 65% and 57% for testingresults. The results highlight the models’ effec-tiveness in handling the nuances of code-mixedtext while underscoring the challenges of under-represented classes. This work contributes tothe ongoing effort to develop automated toolsfor detecting and mitigating harmful contentonline, paving the way for safer and more in-clusive digital spaces.
Anthology ID:
2024.icon-fauxhate.5
Volume:
Proceedings of the 21st International Conference on Natural Language Processing (ICON): Shared Task on Decoding Fake Narratives in Spreading Hateful Stories (Faux-Hate)
Month:
December
Year:
2024
Address:
AU-KBC Research Centre, Chennai, India
Editors:
Shankar Biradar, Kasu Sai Kartheek Reddy, Sunil Saumya, Md. Shad Akhtar
Venue:
ICON
SIG:
SIGLEX
Publisher:
NLP Association of India (NLPAI)
Note:
Pages:
22–28
Language:
URL:
https://aclanthology.org/2024.icon-fauxhate.5/
DOI:
Bibkey:
Cite (ACL):
Advaitha Vetagiri and Partha Pakray. 2024. Detecting Hate Speech and Fake Narratives in Code-Mixed Hinglish Social Media Text. In Proceedings of the 21st International Conference on Natural Language Processing (ICON): Shared Task on Decoding Fake Narratives in Spreading Hateful Stories (Faux-Hate), pages 22–28, AU-KBC Research Centre, Chennai, India. NLP Association of India (NLPAI).
Cite (Informal):
Detecting Hate Speech and Fake Narratives in Code-Mixed Hinglish Social Media Text (Vetagiri & Pakray, ICON 2024)
Copy Citation:
PDF:
https://aclanthology.org/2024.icon-fauxhate.5.pdf