Like any genAI model,Horned Japanese Female College Student: Pleasure Share House Google Gemini responses can sometimes be inaccurate, but in this case it might be because testers don't have the expertise to fact-check them.
According to TechCrunch, the firm hired to improve accuracy for Gemini is now making its testers evaluate responses even if they don't have the "domain knowledge."
SEE ALSO: Google adds Deep Research to Gemini for browsing the web on your behalfThe report raises questions about the rigor and standards Google says it applies to testing Gemini for accuracy. In the "Building responsibly" section of the Gemini 2.0 announcement, Google said it is "working with trusted testers and external experts and performing extensive risk assessments and safety and assurance evaluations." There's a reasonable focus on evaluating responses for sensitive and harmful content, but less attention is paid to responses that aren't necessarily dangerous but just inaccurate.
Google seems to disregard the hallucination and error problem by simply adding a disclaimer that "Gemini can make mistakes, so double-check it," which effectively absolves it from any responsibility. But that doesn't account for the humans doing the work behind the scenes.
Previously GlobalLogic, a subsidiary of Hitachi, instructed its prompt engineers and analysts to skip a Gemini response they didn't fully understand. "If you do not have critical expertise (e.g. coding, math) to rate this prompt, please skip this task," said the guidelines viewed by the outlet.
But last week, GlobalLogic changed its instructions, saying, "You should not skip prompts that require specialized domain knowledge," and to instead "rate the parts of the prompt you understand," and note that they don't have the required expertise in their analysis. Expertise, in other words, is not being treated as a prerequisite for this work.
Contractors can now only skip prompts that are "completely missing information," according to TechCrunch, or those that contain sensitive content that requires a consent form.
Topics Artificial Intelligence Google
The Ideal Smartphone for 2017
The government’s Signal leak is a national security nightmare, but the memes are great
Amazon Big Spring Sale 2025: Best Beats Studio Buds deal
Amazon Spring Sale 2025: Kindle Colorsoft at record
Here's how I feel about all this Stephen Hawking 'news' going around
Amazon Big Spring Sale 2025: Best Apple AirTag deals
How to sign up for Walmart+ and access member perks
Leaked iOS 19 screenshot reveals potential interface
Apple is advertising on Elon Musk's X again
Today's Hurdle hints and answers for March 25, 2025
Amazon CEO tries to sell kids on working on the moon
Chile vs. Ecuador 2025 livestream: Watch World Cup Qualifiers for free
Amazon Spring Sale 2025: Best Apple AirPods 4 deal
Amazon Big Spring Sale travel deals: Luggage, chargers, and more
Amazon Prime members gets 10% off Grubhub orders through Feb. 17
Tesla sales are down bad in Europe, and it's probably because of Musk
Amazon Spring Sale 2025: TCL 85
Amazon Big Spring Sale 2025: Best sleep deals
Best AirPods deal: Apple AirPods 4 for $99.99 at Amazon
Leaked iOS 19 screenshot reveals potential interface
Julian Assange, the coTesla's Model 3 shenanigans are getting ridiculous'Meet Joe Black' (1998) is having a strange rebirth on Twitter'Game of Thrones': Everything to know about dragonglass'Game of Thrones': Everything to know about dragonglassMuslim women are scared to wear the hijab in public after Trump winSharp reveals new phone display that bends in half like a clamshellJulian Assange arrest: Why free speech advocates are worriedThe Chinese city that makes the world's flags knew Trump would winNetflix's 'Black Summer' is a middling zombie thrillerScientists explain the first ever picture of a black holeTrump once said the very thing that elected him was a 'disaster for democracy'Sharp reveals new phone display that bends in half like a clamshellBrits are relieved they're no longer the world's biggest f*ckupsOffensive and 'sexist' camper vans to be banned in Australian state'Game of Thrones': Nobody should end up on the Iron ThroneAmericans wonder if they'll need Chinese lessons soonCoinbase lets UK users spend bitcoins with new Visa debit card'The Rise of Skywalker' trailer analysis: Everything old is new again25 positive tweets for people who are traumatized by the U.S. election Will Ferrell stars in PSA campaign to remind you to put your phone away Every Halloween I get really excited to watch the only Frankenstein movie Instagram Stories maxes out at 100 posts Nintendo Switch gives users 2 big new features in update James Toback is the latest filmmaker to be outed as a sexual predator Creeps can cheaply track your location in real time with online ads Someone found out they failed their midterm in a hilariously tragic Twitter saga 'The Walking Dead' Season 8 premiere explains that Old Rick time Uber to charge some drivers for the chance to earn more Battle Royale Yeah, so a gang of scooter Thor: Ragnarok is the best The Orionid meteor shower peaks this weekend Apple sued for stealing the 'Animoji' name from Japanese developer 'Star Wars: Jedi Challenges' AR headset might be this year's best toy Apple reportedly cuts back iPhone 8 production by more than 50 percent Download this: Spilly lets you remix viral videos with AR effects Essential Phone price slashed to $499 Think you can hack Tinder? Google will pay you How the future technology of 'Blade Runner 2049' reflects our present
1.4549s , 10113.6796875 kb
Copyright © 2025 Powered by 【Horned Japanese Female College Student: Pleasure Share House】,Warmth Information Network