Homelabber uses second-gen Optane memory sticks to run a 2.8-trillion-parameter AI model on CPU alone — warns that Optane's extreme heat can 'burn out' nearby memory DRAM, used blower fans to prevent melting RAM
Hey everyone! Some of you may remember u/APFrisco's post about running a 1T-parameter model (Kimi K2.5) at around 4 tok/s on a first-gen Optane server with 768GB of PMem 100 series in Memory Mode, it was even covered by Tom's Hardware.…