When you purchase through links on our site, we may earn an affiliate commission. Here’s how it works .
Planning like this is not unheard of in the corporate world, with enterprises sometimes running business continuity exercises to account for contingencies. However, what’s concerning is that these exercises are in preparation for a major AI incident, something that many industry experts believe would happen within the next six to 12 months. "OpenAI conducts preparedness exercises where teams discuss and work through a range of potential scenarios," a company spokesperson told the publication. "These scenarios are not treated as inevitable but are meant to help us prepare for a variety of circumstances."
Dario Amodei recently released a warning about an AI-driven botnet “swarm” taking over the entire internet in the coming months, especially after incidents of OpenAI’s models escaping their testing environments . We’ve also heard of incidents where a “kill switch” failed to stop a rogue agent , forcing the startup to pause testing. The threat is so great that Anthropic listed “existential risks to humanity” as one of its major risk factors in its IPO prospectus, allocating nearly a third of the document to covering this issue. A former OpenAI safety employee has spoken out about this, saying that the current risks stem from a lack of safety culture — something that the aviation and nuclear industries have already learned through experience.
Despite that, the White House has refused to impose regulations on artificial intelligence, instead preferring to make Nvidia, OpenAI, Anthropic, and other AI labs promise to “self-police” AI development . But even though the current administration is lenient on AI labs and development, Axios says that one of the things that the scenarios focus on is how to educate Congress after a major incident. An event like this would probably result in Congress attempting to slow or shut down AI development, though planners think that such a move would face significant challenges. It will still likely have an impact on the economy, though, especially as big tech has already spent more than $1 trillion in AI infrastructure , with an additional $32 trillion expected to be invested until 2050 .
The heads of Anthropic, OpenAI, and SpaceXAI have all agreed that a slowdown is needed for AI safety, but it’s unclear what steps these companies have taken to put that into effect. While gaming out scenarios like these is par for the course for any major organization, it still doesn’t give us comfort that they’re essentially preparing for “The Day After Tomorrow” of an AI apocalypse.
OpenAI and Anthropic are reportedly investigating tens of thousands of AI security incidents; OpenAI pauses testing after AI 'kill switch' fails to stop a rogue agent
Anthropic CEO warns of AI-driven botnet 'swarm' taking over the entire internet
Key considerations
- Investor positioning can change fast
- Volatility remains possible near catalysts
- Macro rates and liquidity can dominate flows
Reference reading
- https://www.tomshardware.com/tech-industry/artificial-intelligence/SPONSORED_LINK_URL
- https://www.tomshardware.com/tech-industry/artificial-intelligence/top-ai-labs-reportedly-planning-for-catastrophic-ai-event-fallout-anthropic-openai-and-others-reportedly-building-contingency-plans-and-running-scenarios-of-a-runaway-ai-wreaking-havoc#main
- https://www.tomshardware.com/membership
- The Logitech G29 racing wheel and pedal set is back on sale with steep 37% discount
- At AI Day Singapore, NVIDIA and Partners Showcase AI Advancements Across Southeast Asia
- Free Steam demo runs up $1,000 daily AI bill and forces devs to take out bank loan
- SoftBank seeks $100 billion for AI-refined projects from Middle Eastern investors
- Gigabyte's latest BIOS update hints at Intel's Raptor Lake Next Launch in 2027
Informational only. No financial advice. Do your own research.