NLP@IIMAS-CLTL at Multilingual Counterspeech Generation: Combating Hate Speech Using Contextualized Knowledge Graph Representations and LLMs

David Salvador Márquez, Helena Montserrat Gómez Adorno, Ilia Markov, Selene Báez Santamaría


Abstract
We present our approach for the shared task on Multilingual Counterspeech Generation (MCG) to counteract hate speech (HS) in Spanish, English, Basque, and Italian. To accomplish this, we followed two different strategies: 1) a graph-based generative model that encodes graph representations of knowledge related to hate speech, and 2) leveraging prompts for a large language model (LLM), specifically GPT-4o. We find that our graph-based approach tends to perform better in terms of traditional evaluation metrics (i.e., RougeL, BLEU, BERTScore), while the JudgeLM evaluation employed in the shared task favors the counter-narratives generated by the LLM-based approach, which was ranked second for English and third for Spanish on the leaderboard.
Anthology ID:
2025.mcg-1.4
Volume:
Proceedings of the First Workshop on Multilingual Counterspeech Generation
Month:
January
Year:
2025
Address:
Abu Dhabi, UAE
Editors:
Helena Bonaldi, María Estrella Vallecillo-Rodríguez, Irune Zubiaga, Arturo Montejo-Ráez, Aitor Soroa, María Teresa Martín-Valdivia, Marco Guerini, Rodrigo Agerri
Venues:
MCG | WS
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
29–36
Language:
URL:
https://aclanthology.org/2025.mcg-1.4/
DOI:
Bibkey:
Cite (ACL):
David Salvador Márquez, Helena Montserrat Gómez Adorno, Ilia Markov, and Selene Báez Santamaría. 2025. NLP@IIMAS-CLTL at Multilingual Counterspeech Generation: Combating Hate Speech Using Contextualized Knowledge Graph Representations and LLMs. In Proceedings of the First Workshop on Multilingual Counterspeech Generation, pages 29–36, Abu Dhabi, UAE. Association for Computational Linguistics.
Cite (Informal):
NLP@IIMAS-CLTL at Multilingual Counterspeech Generation: Combating Hate Speech Using Contextualized Knowledge Graph Representations and LLMs (Márquez et al., MCG 2025)
Copy Citation:
PDF:
https://aclanthology.org/2025.mcg-1.4.pdf