Hyderabadi Pearls at Multilingual Counterspeech Generation : HALT : Hate Speech Alleviation using Large Language Models and Transformers

Md Shariq Farhan


Abstract
This paper explores the potential of using fine- tuned Large Language Models (LLMs) for generating counter-narratives (CNs) to combat hate speech (HS). We focus on English and Basque, leveraging the ML_MTCONAN_KN dataset, which provides hate speech and counter-narrative pairs in multiple languages. Our study compares the performance of Mis- tral, Llama, and a Llama-based LLM fine- tuned on a Basque language dataset for CN generation. The generated CNs are evalu- ated using JudgeLM (a LLM to evaluate other LLMs in open-ended scenarios) along with traditional metrics such as ROUGE-L, BLEU, BERTScore, and other traditional metrics. The results demonstrate that fine-tuned LLMs can produce high-quality contextually relevant CNs for low-resource languages that are comparable to human-generated responses, offering a sig- nificant contribution to combating online hate speech across diverse linguistic settings.
Anthology ID:
2025.mcg-1.8
Volume:
Proceedings of the First Workshop on Multilingual Counterspeech Generation
Month:
January
Year:
2025
Address:
Abu Dhabi, UAE
Editors:
Helena Bonaldi, María Estrella Vallecillo-Rodríguez, Irune Zubiaga, Arturo Montejo-Ráez, Aitor Soroa, María Teresa Martín-Valdivia, Marco Guerini, Rodrigo Agerri
Venues:
MCG | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
65–76
Language:
URL:
https://aclanthology.org/2025.mcg-1.8/
DOI:
Bibkey:
Cite (ACL):
Md Shariq Farhan. 2025. Hyderabadi Pearls at Multilingual Counterspeech Generation : HALT : Hate Speech Alleviation using Large Language Models and Transformers. In Proceedings of the First Workshop on Multilingual Counterspeech Generation, pages 65–76, Abu Dhabi, UAE. Association for Computational Linguistics.
Cite (Informal):
Hyderabadi Pearls at Multilingual Counterspeech Generation : HALT : Hate Speech Alleviation using Large Language Models and Transformers (Farhan, MCG 2025)
Copy Citation:
PDF:
https://aclanthology.org/2025.mcg-1.8.pdf