Menu

Which open models actually fit a 12 GB card? We measured instead of guessing
📰

Which open models actually fit a 12 GB card? We measured instead of guessing

DEV Community: machinelearning·AI Compute Radar·about 8 hours ago
#vG8D0nFi
Long article (1524 words) — no AI summary yet.
Reading 0:00
15s threshold

Numbers below are as published on AI Compute Radar on 20 November 2026, for the 49 open-weights models we track. Everything is recomputable from public files; nothing is a benchmark.

The most common question under any model release is "will this run on my card?", and the most common answers are folklore: "about four gigabytes per billion parameters", "add twenty percent for context", "a 12 GB card runs 13B". Those rules were roughly right in 2023. For the models shipping now they can be off by a factor of four, and for one family by forty.

We run a small site that answers the question with arithmetic from published facts, and this post shows the arithmetic, because the interesting part is where the old rules break.

Three numbers decide it

Whether a model fits a card comes down to three quantities and one margin.

Weights. Not estimated from the parameter count: measured from the byte size of a real, published GGUF file.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.