Menu

The rack is the new GPU: capacity planning after SC26
πŸ“°

The rack is the new GPU: capacity planning after SC26

DEV CommunityΒ·RuChatingΒ·about 2 hours ago
#Yw0TwyDM
#devcommunity#dev#rack#capacity#power
Long article (1282 words) β€” no AI summary yet.
Reading 0:00
15s threshold

For most of the last decade, sizing an AI cluster was a surprisingly simple exercise. You picked an accelerator, counted how many you could afford, multiplied by a utilisation figure and called the result your capacity. The building was somebody else's problem β€” a row of racks, some cables, a chiller that had always worked fine.

The announcements coming out of Supercomputing 2026 in Chicago make that habit obsolete. If you are responsible for an inference or training platform now, the unit you should be planning in is not the GPU. It is the rack, the power feed and the water loop β€” plus the exact software build that determines how much work you can extract from the silicon you already own.

What the vendors actually shipped

Look at the pattern in the post-show announcements rather than at any single one. On 18 November, Compal announced a rack-scale liquid-cooled system built on NVIDIA's HGX Rubin NVL8 platform . Giga Computing showed its own rack-scale infrastructure and liquid cooling at the same show.…

Continue reading β€” create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.