Menu

PolyStrata – twelve large models on one normal PC, split across two engines
📰

PolyStrata – twelve large models on one normal PC, split across two engines

DEV Community: security·Private Local AI·about 13 hours ago
#SkD7AtO7
#devtosecurity#devto#dev#card#flash
Reading 0:00
15s threshold

The trick: share the work across the whole PC

Models like these normally live on servers with hundreds of gigabytes of

graphics memory; a gaming card has 8-32 GB. PolyStrata makes them fit by

spreading the model across the machine – the parts you use constantly

stay on the graphics card, the rest wait in system RAM and on the SSD.

It is free, open source, and nothing leaves your PC.

Two engines, twelve models

One model, Qwen3.8-Flash-Next, runs on the Strata project’s engine

unchanged – on an NVIDIA or AMD card with 12 GB or more, on Windows or

Linux, and it reads pictures. The other eleven run on an engine written

for PolyStrata, on one NVIDIA card or two: GLM 5.3 Flash (a 79-114 GB

file, the largest), DeepSeek V4 Flash (91 GB), LFM2.5-24B-A2B, Flint

40B-A2.5B (built for coding agents), Qwen3.6-35B-A3B, Clover-35B-A3B,

Ornith 1.5, Gemma 4 26B-A4B, Tiel Coder, MiniCPM-V and Kolibri 1.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.