Intel displays tech to build extreme multi-chiplet packages 12 times the size of the largest AI processors, beating TSMC's biggest
Given that Intel has the Crescent Island and Jaguar Shores GPUs (and likely, their successors) serving very different market segments — from edge AI inference workloads to on-prem deployments to large-scale inference and training — in the roadmap, at first glance, it does not seem that Intel may need anything else, other than positioning the pair properly. However, these observations are based solely on first impressions, so it's worth digging deeper.
First up, the new product is not meant to compete against heavy-duty Rubin or Feynman GPUs or systems on their base (potentially Jaguar Shores). It is also not meant to compete with Crescent Island. But perhaps it can apply to heterogeneous, latency-sensitive, retrieval-augmented (RAG) AI workloads on-prem? On-prem data center deployments is a market that Intel has served well historically, so this is almost certainly the market it plans to address.
This market now potentially includes a stable of AI workloads, spanning recommendation systems and fraud detection, all the way to physical AI. While clearly distinct, these are all bursty, lightweight models and rule engines under strict latency agreements (SLAs), which is exactly where a tightly integrated hardware succeeds.
Agentic AI systems also fall into this category: they spend much of their time planning, branching, calling tools or databases, and then make small inference steps (albeit with limited batching), which keeps GPUs underutilized, thus demonstrating CPU-GPU synchronization overheads.
In all of the aforementioned cases, workloads are bursty, batch sizes are small, and control flow essentially dominates execution, exactly where tightly integrated heterogeneous processors — with CPUs, fixed-function acceleration, and low-latency interconnects — are a better architectural match than discrete GPU-only platforms.
Despite all of this, there is one elephant in the room for Intel to address. The programmable logic mentioned by the Intel chief exec. Given how fast AI models, and therefore workloads, are evolving, fixed-function silicon would limit flexibility, falling back to CPU and GPU hardware, and to a large degree destroying synchronization. This is where programmable logic comes into play, as it allows frequently used but evolving parts of the workload to be accelerated. However, this part requires very close integration of hardware and software. Whether or not Intel's oneAPI can deliver this remains to be seen, and might even demand its own analysis.
Intel has quietly brought a hybrid AI processors back onto its roadmap: a mysterious design that combines an x86 CPU, fixed-function AI acceleration (with no details about the architecture) to its roadmap. Coupled with Crescent Island and Jaguar Shores products, this one may offer something that AMD and Nvidia do not address at this time.
If executed well, the hybrid approach could let Intel differentiate through tight integration and programmability, though its success will depend on software maturity, particularly around oneAPI.
Anton Shilov is a contributing writer at Tom\u2019s Hardware. Over the past couple of decades, he has covered everything from CPUs and GPUs to supercomputers and from modern process technologies and latest fab tools to high-tech industry trends. ","collapsible":{"enabled":true,"maxHeight":250,"readMoreText":"Read more","readLessText":"Read less"}}), "https://slice.vanilla.futurecdn.net/13-4-12/js/authorBio.js"); } else { console.error('%c FTE ','background: #9306F9; color: #ffffff','no lazy slice hydration function available'); } Anton Shilov Social Links Navigation Contributing Writer Anton Shilov is a contributing writer at Tom’s Hardware. Over the past couple of decades, he has covered everything from CPUs and GPUs to supercomputers and from modern process technologies and latest fab tools to high-tech industry trends.
Key considerations
- Investor positioning can change fast
- Volatility remains possible near catalysts
- Macro rates and liquidity can dominate flows
Reference reading
- https://www.tomshardware.com/tech-industry/artificial-intelligence/SPONSORED_LINK_URL
- https://www.tomshardware.com/tech-industry/artificial-intelligence/intels-roadmap-adds-mysterious-hybrid-ai-processor-featuring-x86-cpus-dedicated-ai-accelerator-and-programmable-ip-chip-may-capitalize-on-a-market-forgotten-by-nvidia-and-amd#main
- https://www.tomshardware.com
- AMD Ryzen 7 9850X3D review: The world's fastest gaming processor, again
- DoomBuds ports the 1993 FPS classic to open-source earbuds by streaming JPGs at 18fps — runs on 300MHz CPU with less than 1MB of RAM
- 'Thermodynamic computing' could slash energy use of AI image generation by a factor of ten billion, study claims — prototypes show promise but huge task require
- Memory prices show signs of levelling out, albeit at inflated levels — some RAM modules stabilizing in price, increases on higher-end kits tapering off
- From Pilot to Profit: Survey Reveals the Financial Services Industry Is Doubling Down on AI Investment and Open Source
Informational only. No financial advice. Do your own research.