Anthropic’s proposed AI safety bill only kicks in if 50 deaths or $1 billion in damages are on the line
The capability scope measurement is easier to interpret: zero means that the jailbreak only works for one specific action or target and can't be tweaked for other applications, or in other words, is a one-trick pony. A jailbreak gets a rating of three when it can, without specific redesign, make a model perform work across at least two entirely unrelated categories of cyber-warfare — like getting the model to both autonomously discover vulnerabilities or, separately, write malware.
For ease of deployment, the FMF considers the amount of human interaction, or the degree of automation that the jailbreak allows. A zero means that the jailbreak must be steered by humans with a high degree of knowledge, providing additional instructions to be effective, while a three means that, with little effort, it can be used by a novice and results in an automated cyber-warfare task.
Last but by no means least, ease-of-discovery is how hard it is to find the jailbreak. At a zero, the attacker must spend copious amounts of money on inference tokens, need elevated access (like a privileged account given to a white-hat hacker), or specialized infrastructure like a legion of AI servers. A rating of three simply means that anyone can look up the technique and use it.
If all of this sounds familiar, you may be thinking of Anthropic's safeguard-breakage classifiers the company proposed in July 2026, after an incident that led to Claude Fable 5 being temporarily unavailable. Much like the FMF's effort, Anthropic's system would also use a moving baseline and only consider jailbreaks that improve on cyber-warfare capabilities already available.
That document is strikingly similar to FMF's proposal. Anthropic is an FMF founding member, and as such may have had a hand or two in developing the new standard — though we have no confirmation either way.
Bruno Ferreira Social Links Navigation Contributor Bruno Ferreira is a contributing writer for Tom's Hardware. He has decades of experience with PC hardware and assorted sundries, alongside a career as a developer. He's obsessed with detail and has a tendency to ramble on the topics he loves. When not doing that, he's usually playing games, or at live music shows and festivals.
Key considerations
- Investor positioning can change fast
- Volatility remains possible near catalysts
- Macro rates and liquidity can dominate flows
Reference reading
- https://www.tomshardware.com/tech-industry/artificial-intelligence/SPONSORED_LINK_URL
- https://www.tomshardware.com/tech-industry/artificial-intelligence/new-framework-grades-ai-jailbreaks-across-capability-gains-scope-and-how-easy-they-are-to-deploy-frontier-model-forum-proposes-cvss-style-rating-system-for-new-ai-models#main
- https://www.tomshardware.com/my-account
- Steam Store adds average FPS data so you can see game performance before making a purchase
- NVIDIA Dynamo Recipes Bring Korea’s Leading Open Models to Production
- Japanese arcades suffer week-long blackout following Sega server hack
- Orbiting ESA satellite plays Doom after receiving voice commands from amateur radio operators on Earth
- Logitech G502 X Lightspeed Review: No lights, same price
Informational only. No financial advice. Do your own research.