768GB of cheap Intel Optane DIMM memory sticks used to run 1-trillion-parameter LLM on a system with a single GPU — local Kimi K2.5 install achieved roughly 4 t

768GB of cheap Intel Optane DIMM memory sticks used to run 1-trillion-parameter LLM on a system with a single GPU — local Kimi K2.5 install achieved roughly 4 t

bit_user usertests said: Intel's poor timing continues to impress years after the fact. Nah, the key detail is that they were purchased used . When new, I think the GB/$ wasn't that much better than DRAM. However, DRAM is now much more expensive, which makes alternative solutions like Optane DIMMs much more attractive. You really can't use this example to reason about Optane's market viability. Reply

JTWrenn bit_user said: Nah, the key detail is that they were purchased used . When new, I think the GB/$ wasn't that much better than DRAM. However, DRAM is now much more expensive, which makes alternative solutions like Optane DIMMs much more attractive. You really can't use this example to reason about Optane's market viability. Agreed, the main reason being that fab usage would be about the same for both so it's not like we would get cheaper anything out of it. Optane just like SSD's would be more expensive anyway. Optane was cool tech that was just not cheap enough to make sense. Reply

usertests bit_user said: Nah, the key detail is that they were purchased used . When new, I think the GB/$ wasn't that much better than DRAM. However, DRAM is now much more expensive, which makes alternative solutions like Optane DIMMs much more attractive. You really can't use this example to reason about Optane's market viability. The $/GB wasn't dramatically less than DRAM, but that could have improved as production scaled up. But they were losing money and didn't stay the course. Since it's off the table, we see solutions like High Bandwidth Flash stepping into the empty tier instead. I guess you can disregard write endurance if the model isn't changing rapidly. Reply

bit_user usertests said: The $/GB wasn't dramatically less than DRAM, but that could have improved as production scaled up. Not faster than DRAM, unless they managed to solve the issues that kept it from scaling in the Z-dimension like it was meant to. usertests said: Since it's off the table, we see solutions like High Bandwidth Flash stepping into the empty tier instead. HBF has yet to be deployed in any solution, so it has yet to be a proven alternative. HBF should have a structural price advantage over Optane, because it's true 3D NAND. Reply

Key considerations

  • Investor positioning can change fast
  • Volatility remains possible near catalysts
  • Macro rates and liquidity can dominate flows

Reference reading

More on this site

Informational only. No financial advice. Do your own research.

Leave a Comment