Evaluating and Mitigating Anti-LGBTQ Biases in German and Multilingual Language Models

Melina Morch, Daniel Braun


Abstract
While gender and racial biases in language models have been widely studied, anti-LGBTQ biases remain underexplored, particularly beyond English. Existing benchmarks often do not capture cultural and linguistic variation and rely on gender representations. This paper introduces a multilingual German-English benchmark dataset for the evaluation of anti-LGBTQ biases in language models. It combines community-sourced stereotypes from German-speaking queer individuals with a German translation of WinoQueer. The data is used to evaluate eight language models across sizes and architectures and explore mitigation through fine-tuning on community and progressive media content. Results show that language models reproduce anti-queer stereotypes, with variation across identities and models. Differences between the translated and community-based data highlight the importance of cultural adaptation for multilingual bias evaluation. Fine-tuning reduces bias on average, but not consistently across models and identities.
Anthology ID:
2026.emnlp-main.2245
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
51072–51087
Language:
URL:
https://aclanthology.org/2026.emnlp-main.2245/
DOI:
Bibkey:
Cite (ACL):
Melina Morch and Daniel Braun. 2026. Evaluating and Mitigating Anti-LGBTQ Biases in German and Multilingual Language Models. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 51072–51087, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Evaluating and Mitigating Anti-LGBTQ Biases in German and Multilingual Language Models (Morch & Braun, EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.2245.pdf