cs.AI updates on arXiv.org 04月16日 12:03
Name of Thrones: Evaluating How LLMs Rank Student Names, Race, and Gender in Status Hierarchies
index_new5.html
../../../zaker_core/zaker_tpl_static/wap/tpl_guoji1.html

 

这项研究深入探讨了大型语言模型(LLMs)中存在的姓名偏见问题。研究者分析了不同种族背景下姓名的变化,揭示了LLMs如何基于姓名对个人的地位进行排序,并可能以不公平的方式强化社会等级。研究发现,LLMs会根据姓名暗示的性别和种族,对能力、领导力和经济潜力产生不同的预期。此外,研究还挑战了关于AI倾向于偏向白人的普遍看法,并指出东亚和南亚姓名有时会获得更高的排名。这项研究强调了在评估LLMs时,需要更细致地理解种族、性别和混合身份的交叉影响。

👩‍💼研究发现,LLMs会根据姓名反映和强化社会地位等级。这些等级基于姓名所暗示的性别和种族,进而影响对个人能力、领导力和经济潜力的期望。

🧐研究结果表明,LLMs并非总是偏向白人。相反,东亚姓名,在某些情况下,南亚姓名会获得更高的排名。

👧研究还发现,性别在偏见中起着调节作用,女孩在某些种族群体中面临不公平的劣势。此外,使用西方名字可以提高东亚和东南亚学生,特别是女孩,在AI中的地位。

arXiv:2504.10797v1 Announce Type: cross Abstract: Across cultures, names tell a lot about their bearers as they carry deep personal and cultural significance. Names also serve as powerful signals of gender, race, and status in the social hierarchy - a pecking order in which individual positions shape others' expectations on their perceived competence and worth. With the widespread adoption of LLMs and as names are often an input for LLMs, it is crucial to evaluate whether LLMs may sort people into status positions based on first and last names and, if so, whether it is in an unfair, biased fashion. While prior work has primarily investigated biases in first names, little attention has been paid to last names and even less to the combined effects of first and last names. In this study, we conduct a large-scale analysis of name variations across 5 ethnicities to examine how AI exhibits name biases. Our study investigates three key characteristics of inequality and finds that LLMs reflect and reinforce status hierarchies based on names that signal gender and ethnicity as they encode differential expectations of competence, leadership, and economic potential. Contrary to the common assumption that AI tends to favor Whites, we show that East and, in some contexts, South Asian names receive higher rankings. We also disaggregate Asians, a population projected to be the largest immigrant group in the U.S. by 2055. Our results challenge the monolithic Asian model minority assumption, illustrating a more complex and stratified model of bias. Gender moderates biases, with girls facing unfair disadvantages in certain racial groups. Additionally, spanning cultural categories by adopting Western first names improves AI-perceived status for East and Southeast Asian students, particularly for girls. Our findings underscore the importance of intersectional and more nuanced understandings of race, gender, and mixed identities in the evaluation of LLMs.

Fish AI Reader

Fish AI Reader

AI辅助创作,多种专业模板,深度分析,高质量内容生成。从观点提取到深度思考,FishAI为您提供全方位的创作支持。新版本引入自定义参数,让您的创作更加个性化和精准。

FishAI

FishAI

鱼阅,AI 时代的下一个智能信息助手,助你摆脱信息焦虑

联系邮箱 441953276@qq.com

相关标签

LLM 姓名偏见 种族 性别 AI
相关文章