When you purchase through links on our site, we may earn an affiliate commission. Here’s how it works .
He said that Silicon Valley lacks the "wisdom about what it means to care for people,” he wrote. “This moment needs a degree of humility that isn’t natural for people who have succeeded through their extreme confidence.”
Because of this, he said that the industry should rely on safety experts that already exist in other fields, like nuclear engineering or aviation. These industries have learned about safety, redundancy, and planning through disasters that have claimed thousands of lives across hundreds of incidents, some of which occurred more than half a century ago but still clearly echo today. These lessons were written in blood, and experts from various sectors worked together to build the systems, procedures, and models we rely on today, helping ensure that no single machine failure or human error would result in tragedy.
“OpenAI and other labs are growing and deploying frontier AI with far less redundancy and rigor than this, even though the harm from an irreversible loss of control would be much greater than the harm from any single meltdown,” Robinson argues. “Even short of a full loss of control, we could see autonomous swarms of AI agents that act without human permission.” This is exactly what Anthropic’s Dario Amodei has been warning about , leading to his proposal of slowing down frontier AI development, to which OpenAI’s Sam Altman and SpaceXAI’s Elon Musk agreed.
However, Nvidia’s Jensen Huang, who supplies the majority of the AI chips needed to train these models, disagreed with the Anthropic CEO’s proposal. If the AI experiments have become unsafe, “ we have to shut the labs down ,” Huang said in an interview. He also cited civil and criminal liabilities that entities may face for rogue agents but called Dario’s concerns a “distraction.” The White House soon called over the heads of the biggest AI companies for high-level discussions, after which President Donald Trump came up with a document where Google , Anthropic, Meta, OpenAI, SpaceXAI, and Nvidia promised to “self-police” AI development.
OpenAI and Anthropic are reportedly investigating tens of thousands of AI security incidents; OpenAI pauses testing after AI 'kill switch' fails to stop a rogue agent
AI leaders clash over safety fears after Anthropic whistleblower says AI could 'kill us all' by 2030
More than 10% chance AI 'could kill all humans' in the next 10 years, Anthropic safety researcher says
Robinson didn’t talk about rules and regulations and instead targeted the core culture of safety (or lack thereof) and OpenAI’s penchant for “iterative deployment,” or more commonly known as trial and error. He said that he should have stayed inside the company and fought for a fundamental shift in its thinking, but said that this was next to impossible because of how fast things were going inside the startup. It’s for this reason that he left his job and decided to tackle the problem from the outside.
Follow Tom's Hardware on Google News , or add us as a preferred source , to get our latest news, analysis, & reviews in your feeds.
Get Tom's Hardware's best news and in-depth reviews, straight to your inbox.
Key considerations
- Investor positioning can change fast
- Volatility remains possible near catalysts
- Macro rates and liquidity can dominate flows
Reference reading
- https://www.tomshardware.com/tech-industry/artificial-intelligence/SPONSORED_LINK_URL
- https://www.tomshardware.com/tech-industry/artificial-intelligence/former-openai-safety-employee-says-companys-safety-culture-is-broken-exits-company-after-failed-kill-switch-and-july-huggingface-hack#main
- https://www.tomshardware.com/membership
- Microsoft using wetlands and native gardens to 'camouflage' 20-plus data center sites by blending them into nature
- AI agents use 5x more tokens than humans as cached prompts explode, headed for 10x
- Portable Bluetooth CD player has a glow-in-the-dark transparent green finish, modern features
- Google freezes open-source bug bounty program amid flood of invalid AI slop submissions
- Tencent scores 100,000 offshore AI chip deal with Oracle for $7 billion despite climbing prices
Informational only. No financial advice. Do your own research.