Menu

#Optane

2 posts

Feed·
2 of 2 posts
Homelabber uses second-gen Optane memory sticks to run a 2.8-trillion-parameter AI model on CPU alone — warns that Optane's extreme heat can 'burn out' nearby memory DRAM, used blower fans to prevent melting RAM
🖼️
0Read More

Homelabber uses second-gen Optane memory sticks to run a 2.8-trillion-parameter AI model on CPU alone — warns that Optane's extreme heat can 'burn out' nearby memory DRAM, used blower fans to prevent melting RAM

#tomshardware#builder#second#optane#build

A Reddit homelab user ran Moonshot AI’s 2.8-trillion-parameter Kimi K3 CPU-only on Optane PMem 200 at 0.85 tokens/s with a 1-bit quant.

15s
Second-gen Optane PMem server running Kimi K3 (2.8T params) on CPU only, plus a critical thermal warning that could save your RAM
📰
0Read More

Second-gen Optane PMem server running Kimi K3 (2.8T params) on CPU only, plus a critical thermal warning that could save your RAM

#homelab#reddithomelab#optane#dram#model

Hey everyone! Some of you may remember u/APFrisco's post about running a 1T-parameter model (Kimi K2.5) at around 4 tok/s on a first-gen Optane server with 768GB of PMem 100 series in Memory Mode, it was even covered by Tom's Hardware.…

15s