Menu

1 / 5

Can You Run Inkling 2 Small Locally? 17B Active, but Plan on 200 GB

DEV Community: opensource·Alan West·9 days ago
#tMgxNuG2
#devtoopensource#devto#dev#inkling#small
Reading 0:00
15s threshold

You can't run Inkling 2 Small locally yet. Thinking Machines shipped the 594B model on November 5, 2026 with closed weights on Tinker , and the Apache 2.0 weights are only promised for next week. When they land, my math says a 2-bit GGUF will want 190 to 200 GB of RAM plus VRAM, so one 128 GB box is out. DeepSeek's 552B model, which you can download today, also beats it on eight of the nine coding benchmarks the two share in the lab's model card .

I haven't run it, because the weights aren't public, and Thinking Machines hasn't published local hardware requirements. Every number marked as an estimate below is my own arithmetic.

Inkling 2 Small specs: 594B total, 17B active

Per the announcement and model card , this is a sparse mixture-of-experts model that routes each token to 8 of 384 experts. It takes text and images, outputs text, "does not support audio", and supports MXFP8 and NVFP4 numerics.

The 17B figure tempts people into comparing this to a 17B model on a gaming GPU.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.