Cyanogen co-founder unveils Kora, a Linux OS that splits AI models across the CPU, GPU, and NPU

Cyanogen co-founder unveils Kora, a Linux OS that splits AI models across the CPU, GPU, and NPU

Beyond NPU stacks, those hoping to run Kora will need to be mindful of their system's available memory. The Gemma 4 26B model Kora uses, which Google lists as Gemma 4 26B A4B, needs about 14.4GB of memory to load its weights at 4-bit (Q4_0) quantization, by Google’s estimate, before any context window, while third-party listings put the download for the Q4_K_M file Kora uses at about 16–17GB. The model only activates about 4 billion of its 26 billion parameters per token but still needs to be fully loaded into memory.

McMaster said that with the model, the X2 Elite reaches “25 TPS decode throughput and 550 TPS prefill throughput,” or tokens per second, running “entirely on the Hexagon NPU with 32K context.” A dense model, rather than a mixture-of-experts, would be far slower. Not given are the RAM configuration or the specific X2 Elite chip.

On memory, McMaster said that “we recommend 64GB because it gives you access to better models,” but that is not a firm requirement. The company projects that “about 70 percent of the model calls it manages will run locally in 2027.”

Kora says its enterprise-focused Humain OS is due first and will be “commercially available in 2027,” on OEM PCs using the Snapdragon X2 Elite. Kora will follow "later in 2027.”

McMaster says that “Kora will be posted on our site and downloadable for anyone to install.” Included will be a list of recommended configurations, “but it should be installable on most modern PCs.” Exact pricing and the overall business model will be shared closer to the date of availability. Edit: 11/11/2026 9:06am PT: Added further follow-up details provided by the maker.

Follow Tom’s Hardware on Google News , or add us as a preferred source , to get our latest news, analysis, & reviews in your feeds.

Shane Downing Social Links Navigation Contributing Writer Shane Downing is a Contributing Writer for Tom’s Hardware, covering consumer storage, PC hardware, and AI.

Key considerations

  • Investor positioning can change fast
  • Volatility remains possible near catalysts
  • Macro rates and liquidity can dominate flows

Reference reading

More on this site

Informational only. No financial advice. Do your own research.

Leave a Comment