Bias in the Tails: How Name-conditioned Evaluative Framing in Resume Summaries Destabilizes LLM-based Hiring

Huy Nghiem, Phuong-Anh Nguyen-Le, Sy-Tuyen Ho, Hal Daumé III


Abstract
Research has documented LLMs’ name-based bias in hiring and salary recommendations. In this paper, we instead consider a setting where LLMs generate candidate summaries for downstream assessment. In a large-scale controlled study, we analyze nearly one million resume summaries produced by 4 models under systematic race–gender name perturbations, using synthetic O*NET-grounded resumes and real-world job postings. By decomposing each summary into resume-grounded factual content and evaluative framing, we find that factual content remains largely stable, while evaluative language exhibits subtle name-conditioned variation concentrated in the extremes of the distribution, especially in open-source models. Our LLM-judged hiring simulation demonstrates how evaluative summary transforms directional harm into symmetric instability that might evade conventional fairness audits in LLM-mediated pipelines, highlighting a potential pathway for LLM-to-LLM automation bias.
Anthology ID:
2026.emnlp-main.1623
Volume:
Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing
Month:
October
Year:
2026
Address:
Budapest, Hungary
Editors:
Hung-Yi Lee, Sunipa Dev, Jessy Li, Desmond Elliott
Venue:
EMNLP
SIG:
SIGDAT
Publisher:
Association for Computational Linguistics
Note:
Pages:
36889–36933
Language:
URL:
https://aclanthology.org/2026.emnlp-main.1623/
DOI:
Bibkey:
Cite (ACL):
Huy Nghiem, Phuong-Anh Nguyen-Le, Sy-Tuyen Ho, and Hal Daumé III. 2026. Bias in the Tails: How Name-conditioned Evaluative Framing in Resume Summaries Destabilizes LLM-based Hiring. In Proceedings of the 2026 Conference on Empirical Methods in Natural Language Processing, pages 36889–36933, Budapest, Hungary. Association for Computational Linguistics.
Cite (Informal):
Bias in the Tails: How Name-conditioned Evaluative Framing in Resume Summaries Destabilizes LLM-based Hiring (Nghiem et al., EMNLP 2026)
Copy Citation:
PDF:
https://aclanthology.org/2026.emnlp-main.1623.pdf