Website owners make money from human views, so AI crawlers need to pay their fair share, too.
When you purchase through links on our site, we may earn an affiliate commission. Here’s how it works .
(Image credit: Getty Images / Sundry Photography) Cloudflare CEO Matthew Prince said that his company has blocked over 416 billion AI bot requests since making it the default option in July of this year after it announced the Content Independence Day initiative. Prince said in an interview with Wired that this feature allows website owners to block AI crawlers by default, unless the AI company pays them to gain access to their content.
“The business model of the internet has always been to generate content that drive traffic and then sell either things, subscriptions, or ads, Prince told Wired . “What I think people don’t realize, though, is that AI is a platform shift. The business model of the internet is about to change dramatically. I don’t know what it’s going to change to, but it’s what I’m spending almost every waking hour thinking about.”
While Cloudflare blocks almost all AI crawlers, there’s one particular bot it cannot block without affecting its customers’ online presence — Google . The search giant combined its search and AI crawler into one, meaning users who opt out of Google’s AI crawler won't be indexed in Google search results. “You can’t opt out of one without opting out of both, which is a real challenge — it’s crazy,” Prince continued. “It shouldn’t be that you can use your monopoly position of yesterday in order to leverage and have a monopoly position in the market of tomorrow.”
AI adoption far outpaces that of the early Internet — report sheds light on worldwide AI penetration and usage patterns
Anthropic targets gigantic $26 billion in revenue by the end of 2026
Key considerations
- Investor positioning can change fast
- Volatility remains possible near catalysts
- Macro rates and liquidity can dominate flows
Reference reading
- https://www.tomshardware.com/tech-industry/big-tech/SPONSORED_LINK_URL
- https://www.tomshardware.com/tech-industry/big-tech/cloudflare-says-it-has-fended-off-416-billion-ai-bot-scrape-requests-in-five-months-ceo-warns-of-dramatic-shift-for-internet-business-model#main
- https://www.tomshardware.com
- Samsung Odyssey G7 S40FG75 40-inch ultra-wide curved gaming monitor review: Fast, gorgeous, and immersive
- Benevolent Facebook trader exchanges 192GB of DDR5 worth $2,200 for one RTX 5070 Ti — says selling at such a high price would have been 'unethical' despite huge
- Intrepid modder builds an M4-powered 4K iMac G3 with 3D-printed parts — guts 90s all-in-one and replaces internals with a Mac mini and an OLED screen
- This MSI Pro 27-inch gaming monitor plummets to its lowest-ever price of $89.99 at Newegg — 1080p, 144Hz display is a gaming and productivity double-threat
- FLUX.2 Image Generation Models Now Released, Optimized for NVIDIA RTX GPUs
Informational only. No financial advice. Do your own research.