Follow Tom's Hardware on Google News , or add us as a preferred source , to get our latest news, analysis, & reviews in your feeds.
Jake Roach Social Links Navigation Senior Analyst, CPUs Jake Roach is the Senior CPU Analyst at Tom’s Hardware, writing reviews, news, and features about the latest consumer and workstation processors.
Darkhands The LLM is most certainly only seeing its sandbox that it uses for commands and scratchpad. And whatever hypervisor its running on probably isn't devoting 8GB ram to each one until it's actually needed. Plus 2TB RAM isn't all that much, especially for a large corporation. That's a single 1U rack server worth. Reply
mac2213 Everyone is lost trying to explain that AMD Turin is running the personal Muse VM and looking to explain that in terms of math and security. Intel booked this deal two years ago for Granite Rapids with AWS when they did the Custom Xeon 6 deal. TDX and AMX solve all the problems that everyone is struggling to square the circle on. There is a place for all three solutions; Nvidia running frontier Llama on Vera/Rubin. AMD running Muse.ai general assistant. And Intel Granite running Muse agents on your own data sets using TDX for security and AMX for matrix math. Stop hating Intel and accept that they got something right here with the Xeon features. Diamond improves on it all. Reply
acadia11 I want to see open claw comparisons, clearly, muse has an installation base advantage with WhatsApp, etc … but it would be nice to see agent capability comparison. Reply
DS426 mac2213 said: Everyone is lost trying to explain that AMD Turin is running the personal Muse VM and looking to explain that in terms of math and security. Intel booked this deal two years ago for Granite Rapids with AWS when they did the Custom Xeon 6 deal. TDX and AMX solve all the problems that everyone is struggling to square the circle on. There is a place for all three solutions; Nvidia running frontier Llama on Vera/Rubin. AMD running Muse.ai general assistant. And Intel Granite running Muse agents on your own data sets using TDX for security and AMX for matrix math. Stop hating Intel and accept that they got something right here with the Xeon features. Diamond improves on it all. What's all that rambling for? AMD has AVX-512 extensions and SEV-SNP for confidential computing/hardened VM's. It really just comes down to the software provider's preference/design and the code path established for such. Yes, the highest-density Xeon's are good for long-horizon agentic AI as well — what's your point? Those security failures are on Meta's security configurations and hardening, not on CPU hardware security. SSH being enabled on the VM doesn't have anything to do with CPU hardware sec. Reply
moon2 mac2213 said: Everyone is lost trying to explain that AMD Turin is running the personal Muse VM and looking to explain that in terms of math and security. Intel booked this deal two years ago for Granite Rapids with AWS when they did the Custom Xeon 6 deal. TDX and AMX solve all the problems that everyone is struggling to square the circle on. There is a place for all three solutions; Nvidia running frontier Llama on Vera/Rubin. AMD running Muse.ai general assistant. And Intel Granite running Muse agents on your own data sets using TDX for security and AMX for matrix math. Stop hating Intel and accept that they got something right here with the Xeon features. Diamond improves on it all. I'm a little lost wondering why you're taking about Intel at all… What's the relevancy of Intel when taking about muse sandboxes and the AMD chips powering it? Reply
mac2213 moon2 said: I'm a little lost wondering why you're taking about Intel at all… What's the relevancy of Intel when taking about muse sandboxes and the AMD chips powering it? When I ask Meta.ai this question; can you give me a benchmark of AVX512 vs AMX running small llama locally that would make sense on why Intel is a more interesting competitive solution for the Muse sandboxed VMs. I get an answer that might change your thinking. Reply
mac2213 DS426 said: What's all that rambling for? AMD has AVX-512 extensions and SEV-SNP for confidential computing/hardened VM's. It really just comes down to the software provider's preference/design and the code path established for such. Yes, the highest-density Xeon's are good for long-horizon agentic AI as well — what's your point? Those security failures are on Meta's security configurations and hardening, not on CPU hardware security. SSH being enabled on the VM doesn't have anything to do with CPU hardware sec. I'll give the same answer here that I gave below. study the Meta ai benchmark comparison of AVX512 vs AMX running small llama locally that would explain why Intel is a more interesting competitive solution for the Muse sandboxed VMs. Reply
jp7189 mac2213 said: I'll give the same answer here that I gave below. study the Meta ai benchmark comparison of AVX512 vs AMX running small llama locally that would explain why Intel is a more interesting competitive solution for the Muse sandboxed VMs. As far as i understand it, these muse instances are only running the harness on the local cpu… no llm at all. The harness then connects to an off box gpu based service for the actual llm. That is why Im confused why it would matter which cpu is faster at llm inference. They both suck and no one in their right mind would waste time trying an llm on 2 cores from any vendor. Reply
Key considerations
- Investor positioning can change fast
- Volatility remains possible near catalysts
- Macro rates and liquidity can dominate flows
Reference reading
- https://www.tomshardware.com/pc-components/cpus/SPONSORED_LINK_URL
- https://www.tomshardware.com/pc-components/cpus/meta-muse-runs-agents-on-amd-epyc-turin-hosts-with-two-cores-and-8gb-of-memory-ai-agent-can-pass-terminal-commands-to-ubuntu-host-system#main
- https://www.tomshardware.com/membership
- New wireless Wi-Fi 7 external GPU box comes with a built-in 4TB SSD for local AI
- How Open Science Can Help Researchers Prepare for the Next Pandemic
- DDR5 laptop memory prices surge 6X in 12 months
- From Megawatts to Tokens: How NVIDIA Maximizes AI Factory Production
- NVIDIA Isaac ROS 5.0 Advances Agentic, Open Source Robotics Development
Informational only. No financial advice. Do your own research.