TikTok parent company ByteDance977 Archivesamassing huge volumes of web data way faster than the other major web crawlers
ByteDance may be planning to release its own LLM, and is aggressively using its web crawler, "Bytespider," to scrape up data to train its models, Fortune reported.
Bytespider showed up on the scene in April, and since then, its rate of consumption puts web scrapers from OpenAI, Google, Meta, and Anthropic to shame.
Sam Crowther, CEO of Kasada, a company that specializes in bot management, told the outlet that Bytespider's scraping rate is 25 times more than OpenAI's GPTbot and 3,000 times the rate of ClaudeBot, which is Anthropic's web crawler for its Claude LLM. Crowther also said that Kasada's data has seen "huge spikes in scraping activity" from Bytespider in the last six weeks.
As Bytespider voraciously consumes the web, the U.S. government is trying to inhibit potential access of American user data to the Chinese government. In April, President Biden signed a bill forcing the ban of TikTok unless it was sold by ByteDance within the year. Given ByteDance's ticking clock for selling TikTok, the sense of urgency fits the massive rate of its web crawling activity — whether for an LLM, a better algorithm, or something else, we don't know.
What ByteDance plans to do with all of its newly-mined data remains to be seen. But TikTok has launched several AI-powered features for the platform. In May, it announced a suite of tools for advertisers to create AI-generated ads, and AI-generated avatars for brands and creators. TikTok is also rumored to be working on an internal search engine, with results powered by AI — possibly using ChatGPT.
Topics Artificial Intelligence TikTok
Previous：The Zuckerberg Follies
Next：The Post-Text Hustle
The Lying Game
iPad accessories on sale: Save on new Apple Pencil Pro, Magic Keyboard
'House of the Dragon' renewed for Season 3
iOS 18 release date: When does it come out?
What In God’s Name Happened To Ricky Gervais?
Scientists discover wild planet that may be covered by a giant ocean
How reptiles took over the world
NASA's Artemis spacecraft will whip around the moon over 42 days
Cops on Campus
TikTok links up with Amazon for in
The Year History Died
Radiant new closeup shows the sun in magnificent detail
Canon Suzhou denies layoff compensation terms amid social media buzz · TechNode
What is the 'meet people twice' theory on TikTok?
Lovesick and Twitter Verified
Webb telescope zooms into the Cartwheel Galaxy
Radiant new closeup shows the sun in magnificent detail
Temu’s Chinese suppliers protest in Guangzhou over penalty policy · TechNode
Looking for Twin Peaks
NASA's Artemis 1 moon megarocket launch was just delayed
Tesla, Xpeng, and more launch new discounts after Chinese New Year holidays · TechNodeLynk & Co’s flagship SUV to feature NVIDIA’s nextFormer Google DeepMind VP joins ByteDance as Seed team research lead · TechNodeToyota sets up whollyFormer Google DeepMind VP joins ByteDance as Seed team research lead · TechNodeUSPS resumes acceptance of packages from China one day after suspension · TechNodeChina's Baidu could launch commercial selfDeepSeek limits registrations amid largeDeepSeek limits registrations amid largeUnitree’s humanoid robots steal the show at 2025 CCTV Spring Festival Gala with AIBaidu CEO says robotaxi business ‘scaleNe Zha 2 becomes highestChinese lidar sensors are enabling autonomous driving in BMW plants · TechNodeSpaceX booster accidentally falls into ocean after rough conditionsEngineAI unveils world's first humanoid robot able to complete front flip · TechNodeEngineAI unveils world's first humanoid robot able to complete front flip · TechNodeChina’s legacy automaker warns of profit plunge amid price war · TechNodeJD Cloud unveils AI advancements at 2025 Cloud City Conference · TechNodeChina’s Lunar New Year box office tops $390 million on second day of holiday · TechNodeFamous Chinese actor Hu Ge becomes Volvo brand ambassador · TechNode New Hubble image of 'fluffy' galaxy is spectacular The reason this dog only eats half her food will break your heart VirZoom's mobile sensor uses Gear VR to turn normal bikes into VR workout machines Trolls are posting photos of fake missing people from London tower fire Facebook criticized by Free Press for empty PR response to ad boycott We shot Portrait mode video with this iPhone app Skittles honors LGBTQ Pride by replacing the rainbow with oh god, no The internet isn't convinced this truck tire isn't a crocodile Netflix's 'Down to Earth' is great if you love Zac Efron: Review ICE tells foreign students taking online Russian hackers hit voting systems in 39 U.S. states Protests surged nationwide on July 4 in a call for a better America Uber users will soon see a 'grocery' button in ride True hero sneaks grandma's dog into hospital by disguising it as a baby The best books of 2020 so far, according to Amazon 'The Shallows' is the summer thriller you've been searching for Uber Boat takes over London commuter ferry for water rides Sure looks like Lorde used to run an Instagram dedicated to onion ring reviews Elon Musk's Neuralink to share 'progress update' soon Amazon fined $135,000 for trade sanctions violations
2.1814s , 8199.0078125 kb
Copyright © 2025 Powered by 【1977 Archives】,Warmth Information Network