A Man’s World: Measuring Gender Bias in Occupational Status Judgments with Vision-Language Models

Ronghao Pan, Tomas Bernal-Beltran, José Antonio García-Díaz, Rafael Valencia-García


Abstract
Vision-language models can be used in applications that analyze people in professional and social contexts. This raises concerns about whether these models reproduce occupational gender stereotypes. However, it is challenging to evaluate these associations because naturally collected images often combine demographic attributes with clothing, pose, background, and other status-related cues. We introduce a paired-image benchmark to study occupational status judgments in VLMs, containing 5,487 human-validated synthetic images spanning 41 ISCO-08 sub-major occupational groups aggregated into 10 major groups, 7 ethnicity categories, and 5 age groups. Men and women are matched based on occupation, age, ethnicity, and workplace context. We evaluate 5 VLMs using spatial comparisons that avoid direct gender references, explicit gender comparisons, and structured reasoning prompts. We observe persistent male-oriented associations in earnings judgments, even when the prompts avoid direct references to gender. Furthermore, we find that men are more frequently associated with authority, seniority, and earning potential, whereas women are more often associated with warmth. Promotion likelihood exhibits a model-family-dependent pattern: male-oriented associations emerge across Qwen-3-VL models, whereas both Gemma-3 models show the opposite, female-oriented pattern. These findings show that occupational gender stereotypes persist in the evaluated VLMs even under tightly controlled visual conditions. Our code and data are publicly available at https://github.com/NLP-UMUTeam/OccuBiasBench
Anthology ID:
2026.findings-emnlp.376
Volume:
Findings of the Association for Computational Linguistics: EMNLP 2026
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
Findings
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
7936–7965
Language:
URL:
https://aclanthology.org/2026.findings-emnlp.376/
DOI:
Bibkey:
Cite (ACL):
Ronghao Pan, Tomas Bernal-Beltran, José Antonio García-Díaz, and Rafael Valencia-García. 2026. A Man’s World: Measuring Gender Bias in Occupational Status Judgments with Vision-Language Models. In Findings of the Association for Computational Linguistics: EMNLP 2026, pages 7936–7965, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
A Man’s World: Measuring Gender Bias in Occupational Status Judgments with Vision-Language Models (Pan et al., Findings 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.findings-emnlp.376.pdf