Bias in the Tails: How Name-conditioned Evaluative Framing in Resume Summaries Destabilizes LLM-based Hiring

arXiv:2604.19984v1 Announce Type: cross Abstract: Research has documented LLMs' name-based bias in hiring and salary recommendations. In this paper, we instead consider a setting where LLMs generate candidate summaries for downstream assessment. In a large-scale controlled study, we analyze nearly one million resume summaries produced by 4 models under systematic race-gender name perturbations, using synthetic resumes and real-world job postings. By decomposing each summary into resume-grounded factual content and evaluative framing, we find that factual content remains largely stable, while evaluative language exhibits subtle name-conditioned variation concentrated in the extremes of the distribution, especially in open-source models. Our hiring simulation demonstrates how evaluative summary transforms directional harm into symmetric instability that might evade conventional fairness audit, highlighting a potential pathway for LLM-to-LLM automation bias.

Related

• Information-Consistent Language Model Recommendations through Group Relative Policy Optimization
• Demographic and Linguistic Bias Evaluation in Omnimodal Language Models
• Contrastive Decoding Mitigates Score Range Bias in LLM-as-a-Judge
• Large Language Models Exhibit Normative Conformity
• Distributional Open-Ended Evaluation of LLM Cultural Value Alignment Based on Value Codebook

Source: arXiv cs.AI | 2026-04-23