You can't run Inkling 2 Small locally yet. Thinking Machines shipped the 594B model on November 5, 2026 with closed weights on Tinker , and the Apache 2.0 weights are only promised for next week. When they land, my math says a 2-bit GGUF will want 190 to 200 GB of RAM plus VRAM, so one 128 GB box is out. DeepSeek's 552B model, which you can download today, also beats it on eight of the nine coding benchmarks the two share in the lab's model card .
I haven't run it, because the weights aren't public, and Thinking Machines hasn't published local hardware requirements. Every number marked as an estimate below is my own arithmetic.
Inkling 2 Small specs: 594B total, 17B active
Per the announcement and model card , this is a sparse mixture-of-experts model that routes each token to 8 of 384 experts. It takes text and images, outputs text, "does not support audio", and supports MXFP8 and NVFP4 numerics.
The 17B figure tempts people into comparing this to a 17B model on a gaming GPU.…