When you purchase through links on our site, we may earn an affiliate commission. Here’s how it works .
“The way we approached that design was really in terms of de-risking and being able to do that design fast. Vera, as a standalone, is a little bit behind on that maturity level. The Turing device is strong. It did what we needed to do, and partly our partners had some experience with it,” Ho told Tom’s Hardware Premium. “For the Jalapeño program, we were trying to make very pragmatic decisions. We wanted to be aggressive on the goals of the performance and the cost, but we didn’t want to take unnecessary risks. That felt like a good design decision that would fit within the parameters of how we make these design decisions."
There are many Arm-based CPUs on the market, many of which are deployed internally at different hyperscalers, such as Google Cloud’s Axiom and AWS’ Graviton, but Vera and Arm’s own AGI have been described as agentic CPUs, purportedly accelerating the complex reasoning involved in agentic loops compared to their x86 counterparts from AMD and Intel. We asked Ho about this dynamic, and why Turin was the right choice given the close working relationship between OpenAI and Nvidia, who responded with the quote above.
Arm has long touted the virtues of the AArch64 ISA compared to x86, going as far as to claim that its own AGI CPU provides more than twice the performance of modern x86 platforms. That claim is based on internal estimates, not real benchmarks , however. The company has been naturally bullish on AGI’s adoption in the market, though even with an impressive $2 billion in commitments, analysts say the market penetration will still be in the low single digits after two years.
With the explosion of server CPU demand this year and evolving agentic workloads, Nvidia has been at the forefront of messaging, comparing its Arm-based Vera to the x86 competition, boldly claiming a 1.8x improvement over a competing AMD Turin chip; a figure that’s extracted from an overall benchmark suite showing Vera just 3% ahead of AMD’s EPYC 9755.
OpenAI's custom Jalapeno AI inference ASIC is for OpenAI’s internal use, but company leaves the door open to broader rollout
OpenAI’s 700W Jalapeño ASIC outpaces 1,400W Nvidia flagship GPU
Key considerations
- Investor positioning can change fast
- Volatility remains possible near catalysts
- Macro rates and liquidity can dominate flows
Reference reading
- https://www.tomshardware.com/pc-components/cpus/SPONSORED_LINK_URL
- https://www.tomshardware.com/pc-components/cpus/openais-jalapeno-asics-are-deployed-alongside-amd-epyc-turin-cpus-as-hosts-hardware-vp-says-nvidias-vera-standalone-is-a-little-bit-behind-on-that-maturity-level#main
- https://www.tomshardware.com/membership
- Micron now has an 88% margin on consumer memory as price hikes drive profits
- Grab an $80 discount on this TP-Link Wi-Fi 7 router with five 2.5G Ethernet ports, now $169.99
- Grab this 10-port gigabit PoE+ switch with up to 60W of power for under $38, a new record low
- The price of AI is crashing faster than the rate of Moore's Law, report suggests
- Save $50 on Elgato's biggest Stream Deck
Informational only. No financial advice. Do your own research.