Website owners make money from human views, so AI crawlers need to pay their fair share, too.
When you purchase through links on our site, we may earn an affiliate commission. Here’s how it works .
(Image credit: Getty Images / Sundry Photography) Cloudflare CEO Matthew Prince said that his company has blocked over 416 billion AI bot requests since making it the default option in July of this year after it announced the Content Independence Day initiative. Prince said in an interview with Wired that this feature allows website owners to block AI crawlers by default, unless the AI company pays them to gain access to their content.
“The business model of the internet has always been to generate content that drive traffic and then sell either things, subscriptions, or ads, Prince told Wired . “What I think people don’t realize, though, is that AI is a platform shift. The business model of the internet is about to change dramatically. I don’t know what it’s going to change to, but it’s what I’m spending almost every waking hour thinking about.”
While Cloudflare blocks almost all AI crawlers, there’s one particular bot it cannot block without affecting its customers’ online presence — Google . The search giant combined its search and AI crawler into one, meaning users who opt out of Google’s AI crawler won't be indexed in Google search results. “You can’t opt out of one without opting out of both, which is a real challenge — it’s crazy,” Prince continued. “It shouldn’t be that you can use your monopoly position of yesterday in order to leverage and have a monopoly position in the market of tomorrow.”
AI adoption far outpaces that of the early Internet — report sheds light on worldwide AI penetration and usage patterns
Anthropic targets gigantic $26 billion in revenue by the end of 2026
Key considerations
- Investor positioning can change fast
- Volatility remains possible near catalysts
- Macro rates and liquidity can dominate flows
Reference reading
- https://www.tomshardware.com/tech-industry/big-tech/SPONSORED_LINK_URL
- https://www.tomshardware.com/tech-industry/big-tech/cloudflare-says-it-has-fended-off-416-billion-ai-bot-scrape-requests-in-five-months-ceo-warns-of-dramatic-shift-for-internet-business-model#main
- https://www.tomshardware.com
- NVIDIA Partners With Mistral AI to Accelerate New Family of Open Models
- SoftBank CEO Masayoshi Son wants to build ‘Trump Industrial Parks’ across the nation, report claims — project proposes using federal land to build manufacturing
- Enthusiast adds OCuLink port to Framework 16 Laptop — offering PCIe 4.0 x8 bandwidth for big GPU performance gains
- Windows 11 update designed to improve dark mode greets users with a flashbang — preview build stuns unsuspecting eyeballs
- GeForce 590 driver branch is the first without feature support for GTX 9- and 10-series GPUs — Linux release marks the end of the line for graphics cards that d
Informational only. No financial advice. Do your own research.