Detecting Gender Stereotypical Language Using Model-agnostic and Model-specific Explanations

Manuela Nayantara Jeyaraj, Sarah Jane Delany


Abstract
AI models learn gender-stereotypical language from human data. So, understanding how well different explanation techniques capture diverse language features that suggest gender stereotypes in text can be useful in identifying stereotypes that could potentially lead to gender bias. The influential words identified by four explanation techniques (LIME, SHAP, Integrated Gradients (IG) and Attention) in a gender stereotype detection task were compared with words annotated by human evaluators. All techniques emphasized adjectives and verbs related to characteristic traits and gender roles as the most influential words. LIME was best at detecting explicitly gendered words, while SHAP, IG and Attention showed stronger overall alignment and considerable overlap. A combination of these techniques, combining the strengths of model-agnostic and model-specific explanations, performs better at capturing gender-stereotypical language. Extending to hate speech and sentiment prediction tasks, annotator agreement suggests these tasks to be more subjective while explanation techniques can better capture explicit markers in hate speech than the more nuanced gender stereotypes. This research highlights the strengths of different explanation techniques in capturing subjective gender stereotype language in text.
Anthology ID:
2025.ranlp-1.57
Volume:
Proceedings of the 15th International Conference on Recent Advances in Natural Language Processing - Natural Language Processing in the Generative AI Era
Month:
September
Year:
2025
Address:
Varna, Bulgaria
Editors:
Galia Angelova, Maria Kunilovskaya, Marie Escribe, Ruslan Mitkov
Venue:
RANLP
SIG:
Publisher:
INCOMA Ltd., Shoumen, Bulgaria
Note:
Pages:
481–490
Language:
URL:
https://aclanthology.org/2025.ranlp-1.57/
DOI:
Bibkey:
Cite (ACL):
Manuela Nayantara Jeyaraj and Sarah Jane Delany. 2025. Detecting Gender Stereotypical Language Using Model-agnostic and Model-specific Explanations. In Proceedings of the 15th International Conference on Recent Advances in Natural Language Processing - Natural Language Processing in the Generative AI Era, pages 481–490, Varna, Bulgaria. INCOMA Ltd., Shoumen, Bulgaria.
Cite (Informal):
Detecting Gender Stereotypical Language Using Model-agnostic and Model-specific Explanations (Jeyaraj & Delany, RANLP 2025)
Copy Citation:
PDF:
https://aclanthology.org/2025.ranlp-1.57.pdf