Nvidia says it’s ‘absurd’ to assume it predicted the agentic moment during Vera’s development

Nvidia says it’s ‘absurd’ to assume it predicted the agentic moment during Vera’s development

Nvidia claims its Vera CPU can gain up to 39% performance boost via software optimization at SC26 — architectural fine-tuning is needed to fully unleash custom Olympus cores

Finder provided an example of using a coding agent. If you’ve used a coding agent before, you’re probably familiar with this process. After prompting, the model will make several small tool calls to read and locate files, passing back to the model in between. These are tiny calls, almost negligible, and the vast majority of the time is spent in the model on the GPU. Then, it may start compiling and testing the project, which is much more bound by the CPU. The GPU, Finder says, isn't sitting idle during that time. It’s being leveraged for another purpose. Finder suggests “that very same thing is going to happen on the CPU.”

This “very interesting computer science problem,” as Finder described it, is being investigated by AI startups such as Daytona and E2B to spin up and close down agentic sandboxes in milliseconds. And serving more agents will naturally put pressure on the memory system, which is an area where Vera has an edge. “We built a product that does really, really well without such optimizations, but as a design point that really will lean into them when the industry starts to catch up to this,” Finder said.

Vera is a fascinating chip, regardless of what you think of it and how it’s presented in marketing materials (from Nvidia itself or elsewhere). Although Grace was the starting point internally, Vera has ridden the wave of agentic to become a much bigger player in the world of CPUs, and Nvidia has already announced that it will follow up with its Rosa CPU featuring the new Rigel microarchitecture. Vera is an opinionated CPU indeed, and time will tell if that opinion is correct.

Jake Roach Social Links Navigation Senior Analyst, CPUs Jake Roach is the Senior CPU Analyst at Tom’s Hardware, writing reviews, news, and features about the latest consumer and workstation processors.

Pierce2623 Oh thats funny. I said the same thing about how it couldn’t have been designed around agentic workloads and somebody here argued by finding g one reference to agentic workloads in a 2024 page (even though that was still much later than the point we’d started seeing Vera Rubin on roadmaps). Now Nvidia has come out wiith quotes admitting I’m right. Nice. Reply

wwenze1 They didn't need to predict… coz they shape the development… Reply

Key considerations

  • Investor positioning can change fast
  • Volatility remains possible near catalysts
  • Macro rates and liquidity can dominate flows

Reference reading

More on this site

Informational only. No financial advice. Do your own research.

Leave a Comment