In a refrain that feels almost entirely too familiar by now: Generative AI is Watch Mad Jaxxx Beyond Thunderboobs (2002)repeating the biases of its makers.
A new investigation from Bloombergfound that OpenAI's generative AI technology, specifically GPT 3.5, displayed preferences for certain racial in questions about hiring. The implication is that recruiting and human resources professionals who are increasingly incorporating generative AI based tools in their automatic hiring workflows — like LinkedIn's new Gen AI assistant for example — may be promulgating racism. Again, sounds familiar.
The publication used a common and fairly simple experiment of feeding fictitious names and resumes into AI recruiting softwares to see just how quickly the system displayed racial bias. Studies like these have been used for years to spot both human and algorithmic bias among professionals and recruiters.
"Reporters used voter and census data to derive names that are demographically distinct — meaning they are associated with Americans of a particular race or ethnicity at least 90 percent of the time — and randomly assigned them to equally-qualified resumes," the investigation explains. "When asked to rank those resumes 1,000 times, GPT 3.5 — the most broadly-used version of the model — favored names from some demographics more often than others, to an extent that would fail benchmarks used to assess job discrimination against protected groups."
The experiment categorized names into four categories (White, Hispanic, Black, and Asian) and two gender categories (male and female), and submitted them for four different job openings. ChatGPT consistently placed "female names" into roles historically aligned with higher numbers of women employees, such as HR roles, and chose Black women candidates 36 performance less frequently for technical roles like software engineer.
ChatGPT also organized equally ranked resumes unequally across the jobs, skewing rankings depending on gender and race. In a statement to Bloomberg, OpenAI said this doesn't reflect how most clients incorporate their software in practice, noting that many businesses fine tune responses to mitigate bias. Bloomberg's investigation also consulted 33 AI researchers, recruiters, computer scientists, lawyers, and other experts to provide context for the results.
The report isn't revolutionary among the years of work by advocates and researchers who warn against the ethical debt of AI reliance, but it's a powerful reminder of the dangers of widespread generative AI adoption without due attention. As just a few major players dominate the market, and thus the software and data building our smart assistants and algorithms, the pathways for diversity narrow. As Mashable's Cecily Mauran reported in an examination of the internet's AI monolith, incestuous AI development (or building models that are no longer trained on human input but other AI models) leads to a decline in quality, reliability, and, most importantly, diversity.
And, as watchdogs like AI Nowargue, "humans in the loop" might not be able to help.
Topics Artificial Intelligence Social Good ChatGPT
Best robot vacuum deal: Eufy Omni C20 robot vacuum and mop $300 off at Amazon
'Freaky' is the cuddly body
Poor pup, like all of us, is terrified of a giant spider
Poor pup, like all of us, is terrified of a giant spider
NYT mini crossword answers for May 12, 2025
Fair warning: Chelsea Handler's story about adopting a senior dog will make you cry
Get a sneek peek at the snazzy cover and excerpt for this Mashable writer's debut novel
'Bugsnax' review: Chaotic fun with a confusing center
President Trump says semiconductor tariffs are next
White supremacist rally ends early in Boston as counter
Today's Hurdle hints and answers for April 7, 2025
'The Mandalorian' births a new internet STAR: Mon Cal in a sweater
Selena Gomez seriously has a twin and we can't tell who's who
ICE abolished its own Twitter account by mistake
NYT Connections Sports Edition hints and answers for March 4: Tips to solve Connections #162
Yes, Donald Trump just retweeted a bot to rant about the 'fake news media'
Did Trump forget about his TikTok ban? TikTok would like to know.
'Freaky' is the cuddly body
Nvidia RTX 5070: Where to buy and is it worth the upgrade?
Rare baby white koala looks for a name on Facebook
Jill Stein wants you to give her $2.5 million to contest the 2016 election resultsTwitter's ongoing strategy? Video, video, video.PM Narendra Modi says everyone on Narendra Modi app is happy with demonetization'Yes we cran': 9 dad jokes from Obama's final turkey pardoningFacebook's ideals: As fake as its fakest newsThe NHL has a new team and people are already mocking it'This Is Us' recap: Thanksgiving episode is stuffed with revelationsWitness a potential Trump cabinet member DJ for Vanilla IceFan mashes up 'E.T.' and 'Star Wars' to create ETPOMacy's Thanksgiving Day Parade will be livestreamed in 360 degreesAdorable pit bull learns to sing his nameThis is how you celebrate Thanksgiving in spaceFlawless BeyoncéThe 'Game of Thrones' wine that would make Tyrion proudScientists film footage of extremely ancient deep sea creaturesLive.ly now lets you give gifts to your favorite starsAustralian politician shares deeply personal experience with domestic violenceTrump backs away from pledge to 'cancel' Paris Climate AgreementThe small, foldable DJI Mavic Pro is the ultimate personal drone'This Is Us' recap: Thanksgiving episode is stuffed with revelations BBC presenter films live TV show in underwear, Twitter totally loses it New York's 9/11 mayor conveniently forgets about 9/11 6 horror movies with paranormal hauntings reported on set Egyptian judoka rejects handshake with Israeli opponent Politician makes comment about feminists, women have best response New, spooky photo of the Ghost Nebula glows just in time for Halloween Badass squirrel invades British store, browses red wine selection Meet Aaron Gouveia, the dad who defended son's nail polish in viral Twitter thread Trump's media attack nods toward conspiracy, and it has his supporters crying it too ‘The Chilling Adventures of Sabrina’ Review: A slow build, but worth it These are the best Halloween thruples costumes Andy Murray owns BBC reporter who forgot women's tennis Young swimmers are so inspired by historic Olympian Simone Manuel Posting about your workout on Facebook means you're a narcissist, study says French 'Spider Man' returns, scales one of London's tallest buildings without a rope After iPhone spying report, China suggests Trump switch to Huawei Xiaomi Mi Mix 3 has tiny bezels and 10GB of RAM The 747 that went to Burning Man: What really happened The Pooppening: Roomba spreads poop all over house 2018 iPad Pro redesign will look kind of like the iPhone 5: Report
1.6085s , 10135.015625 kb
Copyright © 2025 Powered by 【Watch Mad Jaxxx Beyond Thunderboobs (2002)】,Warmth Information Network