GSI:detect - A Perspectivist Approach to Gender Stereotypes Identification in Italian

Davide Testa, Sofia Brenna, Manuela Speranza, Gloria Comandini, Stefania Cavagnoli, Bernardo Magnini


Abstract
The deconstruction of gender stereotypes is essential to prevent discrimination, marginalization and gender-based violence. Despite the increasing attention to this issue, research in this field often focuses on explicitly sexist or hateful communication, leaving out all the cases where stereotypes are produced unconsciously or even with apparently positive intentions. Moreover, the identification and analysis of gender stereotypes is often a very subjective task, heavily influenced by the researcher’s background, beliefs and personal sensitivity. In this context GSI:detect, a dataset for gender stereotypes identification in Italian, has been annotated following a perspectivist approach that gives value to the different points of view of four annotators. It has been designed to address (i) the lack of resources focusing on naturally occurring and non-hateful language conveying implicit or ambiguous forms of gender stereotypes, and (ii) the scarcity of datasets that can capture multiple interpretations as well as the inherent variation and disagreement in human perception. Baseline experiments with several LLMs confirm the challenging nature and value of such a linguistic resource, revealing both apparent differences and limitations in performance among the evaluated models, and raising questions about the extent to which current LLMs are suitable for detection and classification tasks in this field. Content warning: Examples taken from the GSI:detect dataset may contain sensitive or potentially distressing content.
Anthology ID:
2026.nlperspectives-1.3
Volume:
Proceedings of the the fifth edition of NLPerspectives
Month:
May
Year:
2026
Address:
Palma, Mallorca (Spain)
Editors:
Shiran Dudy, Gavin Abercrombie, Valerio Basile, Elisa Leonardelli, Simona Frenda
Venues:
NLPerspectives | WS
SIG:
Publisher:
ELRA Language Resources Association (ELRA)
Note:
Pages:
21–32
Language:
External URL:
https://lrec.elra.info/lrec2026-ws-nlperspectives-03
DOI:
10.63317/373ps8r3346w
Bibkey:
Cite (ACL):
Davide Testa, Sofia Brenna, Manuela Speranza, Gloria Comandini, Stefania Cavagnoli, and Bernardo Magnini. 2026. GSI:detect - A Perspectivist Approach to Gender Stereotypes Identification in Italian. In Proceedings of the the fifth edition of NLPerspectives, pages 21–32, Palma, Mallorca (Spain). ELRA Language Resources Association (ELRA).
Cite (Informal):
GSI:detect - A Perspectivist Approach to Gender Stereotypes Identification in Italian (Testa et al., NLPerspectives 2026)
Copy Citation: