Menu

1 / 3

How much does an NVIDIA B200 cost to buy or rent?

DEV Community: machinelearning·Viswaretas Kotra·7 days ago
#1EYBCpSM
Reading 0:00
15s threshold

An NVIDIA B200 costs $5.50 to $7.99 per GPU-hour on demand, and Nodus lists it at $5.50/hr, the lowest of the four rates we checked. To buy one, you buy an 8-GPU system: one US reseller lists the DGX B200 at $591,114.20, or $73,889.28 per GPU. Nodus runs your job on the cheapest capacity that will finish it, so you pay for the GPU-hours you use, not for a machine that waits.

Buying beats that rate only if all eight GPUs stay busy more than about 60% of the time for three years. The rest of this post shows that math once, with every input you can change: the purchase price, the running cost of owned hardware, a priced 72-hour job and a utilization rule for deciding.

Why can't you just buy one B200?

Because NVIDIA sells it as part of an 8-GPU board, not as a card. The B200 is an SXM module that ships on NVIDIA HGX baseboards and in the DGX B200 , which NVIDIA lists with eight GPUs, 1,440 GB of HBM3e and about 14.3 kW of maximum system power.

That is also why the memory figure varies.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.