
AMD VP and chief Zen architect rebuke claims that Nvidia and Arm made CPUs for agentic AI — ‘We didn’t magically know four years ago that agentic was going to be a thing’
Modal taps Nvidia Vera CPUs after firm's internal tests show 2x throughput over Intel and AMD chips
This “clean sheet of paper” approach, and Nvidia’s codesign, led to some natural assumptions about what the CPU should do. “If we have silicon that needs really, really great single-thread performance, [and] we also need concurrency, then we need to get there with IPC instead of frequency. We need to make sure we have good loaded memory latency. We need to make sure we have a lot of bandwidth, and you start to design something on a clean sheet of paper that's not encumbered by dollar-per-core economics.”
Although Finder was clear that Vera’s design didn’t explicitly center around the agents we see today, there were early indications of the workload. “To say that four years ago, when we started putting pen to paper on Vera, [that] we absolutely saw the agentic moment, would [not] be… something I would claim, but we were starting to see the beginnings of tool calling and things like that. We certainly knew what we needed from a head node, and we knew the overall shape of this problem.”
As you can see in our Vera CPU benchmarking , the chip doesn’t excel at every workload. And, from the data you can see in our recent AMD EPYC Venice benchmarking , the AMD camp has reclaimed some top spots in several benchmarks . Finder suggests that the superior memory bandwidth of Vera will play a much bigger role in the agentic future as these systems evolve to take better advantage of the compute available.
A portion of the AI industry is focused on tackling the problem of fully utilizing the GPU, Nvidia included. GPUs shouldn’t sit idle for very long (if at all) with the demand today, and they don’t. The challenge today is spinning up these agent sandboxes quickly, within milliseconds, so that the CPU isn’t sitting idle, either.
Benchmarking Nvidia’s Vera CPU for the data center — standalone Vera tested against Granite Rapids-AP and EPYC Turin
Standalone Nvidia Vera CPUs land in Oracle Cloud's multi-gigawatt deployment
Key considerations
- Investor positioning can change fast
- Volatility remains possible near catalysts
- Macro rates and liquidity can dominate flows
Reference reading
- https://www.tomshardware.com/pc-components/cpus/SPONSORED_LINK_URL
- https://www.tomshardware.com/pc-components/cpus/nvidia-says-its-absurd-to-assume-it-predicted-the-agentic-moment-during-veras-development-product-intuition-helped-drive-cpu-design-superior-memory-bandwidth-will-play-critical-role-in-future-ai-agents-cpu-boss-claims#main
- https://www.tomshardware.com/my-account
- SSDs, laptops, and phones may get cheaper as consumer NAND spot pricing drops 20%
- NVIDIA Expands Slurm to Bring Quantum Computing Into Supercomputing
- Practice Makes Precise: At CoRL, NVIDIA and Partners Reveal How Robots Rehearse Delicate Work in Simulation
- Retro Kickstarter speaker can play soundtracks directly from original Game Boy cartridges
- New US rules aim to restrict Chinese firms’ remote access to AI servers and infrastructure
Informational only. No financial advice. Do your own research.