QueerGen: How LLMs Reflect Societal Norms on Gender and Sexuality in Sentence Completion Task

Mae Sosto, Delfina S. Martinez Pandiani, Laura Hollink


Abstract
This paper examines how Large Language Models (LLMs) reproduce societal norms, particularly heterocisnormativity, and how these norms translate into measurable biases in their text generations. We investigate whether explicit information about a subject’s gender or sexuality influences LLM responses across three subject categories: queer-marked, non-queer-marked, and the normalized "unmarked" category. Representational imbalances are operationalized as measurable differences in English sentence completions across four dimensions: sentiment, regard, toxicity, and prediction diversity. Our findings show that Masked Language Models (MLMs) produce the least favorable sentiment, higher toxicity, and more negative regard for queer-marked subjects. Autoregressive Language Models (ARLMs) partially mitigate these patterns, while closed-access ARLMs tend to produce more harmful outputs for unmarked subjects. Results suggest that LLMs reproduce normative social assumptions, though the form and degree of bias depend strongly on specific model characteristics, which may redistribute—but not eliminate—representational harms.
Anthology ID:
2026.findings-eacl.225
Volume:
Findings of the Association for Computational Linguistics: EACL 2026
Month:
March
Year:
2026
Address:
Rabat, Morocco
Editors:
Vera Demberg, Kentaro Inui, Lluís Marquez
Venue:
Findings
SIG:
Publisher:
Association for Computational Linguistics
Note:
Pages:
4305–4326
Language:
URL:
https://aclanthology.org/2026.findings-eacl.225/
DOI:
Bibkey:
Cite (ACL):
Mae Sosto, Delfina S. Martinez Pandiani, and Laura Hollink. 2026. QueerGen: How LLMs Reflect Societal Norms on Gender and Sexuality in Sentence Completion Task. In Findings of the Association for Computational Linguistics: EACL 2026, pages 4305–4326, Rabat, Morocco. Association for Computational Linguistics.
Cite (Informal):
QueerGen: How LLMs Reflect Societal Norms on Gender and Sexuality in Sentence Completion Task (Sosto et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-eacl.225.pdf
Checklist:
 2026.findings-eacl.225.checklist.pdf