Queering the Audits: Community-Based Auditing of AI Harms to Queer Communities

Organizers of Queer In AI, A Pranav, Alissa A. Valentine, Alex Markham, Beckett LeClair, Tereza Blazkova, Ekaterina Kornilitsina, Sofie H. Bruun, Gerasimos Spanakis, Anne Lauscher


Abstract
AI systems embed majority-group defaults into training data, evaluation metrics, and category definitions, producing documented harms for queer communities including erasure, misclassification, and discrimination. Standard technical audits often rely on aggregate measures and cannot detect harms that be come visible only through the lived experience of affected communities. We conducted a participatory auditing workshop at EurIPS 2025 where 16 queer community members audited four case studies using the 4Cs harm taxonomy (Content, Conduct, Contact, Contract) applied across the AI lifecycle. Participants used structured worksheets and plenary synthesis to classify harms and trace them to their origins in the development pipeline. Across all four cases, participants traced harms to problem definition and data collection, and they identified contractual structures that extract value from vulnerable populations while providing minimal recourse. These findings illustrate that community-informed auditing surfaces concrete, identity-specific harms that aggregate evaluation methods risk overlooking.
Anthology ID:
2026.iaai-1.6
Volume:
Proceedings of the Second Workshop of Identity Aware AI
Month:
May
Year:
2026
Address:
Palma de Mallorca, Spain
Editors:
A Pranav, Valerio Basile, Neele Falk, David Jurgens, Gabriella Lapesa, Anne Lauscher, Soda Marem Lo
Venues:
iaai | WS
SIG:
Publisher:
European Language Resources Association
Note:
Pages:
66–76
Language:
External URL:
https://lrec.elra.info/lrec2026-ws-iaai-06
DOI:
10.63317/5acrwqmesyw4
Bibkey:
Cite (ACL):
Organizers of Queer In AI, A Pranav, Alissa A. Valentine, Alex Markham, Beckett LeClair, Tereza Blazkova, Ekaterina Kornilitsina, Sofie H. Bruun, Gerasimos Spanakis, and Anne Lauscher. 2026. Queering the Audits: Community-Based Auditing of AI Harms to Queer Communities. In Proceedings of the Second Workshop of Identity Aware AI, pages 66–76, Palma de Mallorca, Spain. European Language Resources Association.
Cite (Informal):
Queering the Audits: Community-Based Auditing of AI Harms to Queer Communities (Queer In AI et al., iaai 2026)
Copy Citation: