An NVIDIA B200 costs $5.50 to $7.99 per GPU-hour on demand, and Nodus lists it at $5.50/hr, the lowest of the four rates we checked. To buy one, you buy an 8-GPU system: one US reseller lists the DGX B200 at $591,114.20, or $73,889.28 per GPU. Nodus runs your job on the cheapest capacity that will finish it, so you pay for the GPU-hours you use, not for a machine that waits.
Buying beats that rate only if all eight GPUs stay busy more than about 60% of the time for three years. The rest of this post shows that math once, with every input you can change: the purchase price, the running cost of owned hardware, a priced 72-hour job and a utilization rule for deciding.
Why can't you just buy one B200?
Because NVIDIA sells it as part of an 8-GPU board, not as a card. The B200 is an SXM module that ships on NVIDIA HGX baseboards and in the DGX B200 , which NVIDIA lists with eight GPUs, 1,440 GB of HBM3e and about 14.3 kW of maximum system power.
That is also why the memory figure varies.…