Jailbroken PS4 runs 9-billion-parameter AI model at up to 43 tokens per second

Jailbroken PS4 runs 9-billion-parameter AI model at up to 43 tokens per second

The next question is performance. Qwen3.5 comes with a multi-token prediction (MTP) head, and Garlic LLM uses it to draft up to two tokens ahead , with the full model verifying. This matches what the model was trained for, and the vLLM instructions on Alibaba’s model card use two speculative tokens. The project credits this for its chat speed on 2013 hardware.

Code also comes out faster with this setup, at up to 43 tokens per second. Also detailed is the default temperature, or model variability, which is 0.7 — Alibaba recommends 0.7 for general tasks with thinking off and 1.0 with it on — although the demo video uses 0, so it is predictable. At 35 tokens per second, the middle of the reported performance range, a 300-token answer takes under nine seconds. As a comparison, the PS5 ran the three-times-larger Qwen3.8-27B at about 20 tokens per second and the smaller Gemma 4 E4B and Llama 3.2 3B at 61 and 124, respectively, which is potentially quicker.

The PS4 Pro is “not tested yet,” but the developer is asking users for reports on GitHub. The PS5 is not supported as the app is written specifically for the PS4’s GPU and system software. The app itself contains no exploit, but GoldHEN is installed at the user’s own risk.

Follow Tom’s Hardware on Google News , or add us as a preferred source , to get our latest news, analysis, & reviews in your feeds.

Shane Downing Social Links Navigation Contributing Writer Shane Downing is a Contributing Writer for Tom’s Hardware, covering consumer storage, PC hardware, and AI.

bigdragon I have to wonder if this is going to lead to people buying up Playstations the way they've been buying up GPUs. I'm going to laugh so hard if what Sony is claiming to be excitement over GTA 6 turns out to actually be jailbreakers wanting to run local AI on affordable hardware. Reply

usertests bigdragon said: I have to wonder if this is going to lead to people buying up Playstations the way they've been buying up GPUs. I'm going to laugh so hard if what Sony is claiming to be excitement over GTA 6 turns out to actually be jailbreakers wanting to run local AI on affordable hardware. I would only buy PS5/PS6/Xbox if they were fully jailbroken Linux-capable PCs, even if AI didn't exist. I doubt AI will drive PS5 sales. It's kind of like an RX 6700 with 16 GB, but with less memory available if you need to run an operating system. A used PS5 is around $400. You can get a used 7600 XT 16GB for around the same price which should be much better, especially with the PC having its own RAM. Or you go to $700 for an RTX 4060 Ti 16GB to crush it. A PC adds cost, but you might be able to get it down to $200 or less. Main factors being the large case size needed, so no SFF office PCs permitted, and the appropriate power supply. Reply

Key considerations

  • Investor positioning can change fast
  • Volatility remains possible near catalysts
  • Macro rates and liquidity can dominate flows

Reference reading

More on this site

Informational only. No financial advice. Do your own research.

Leave a Comment