Runcrate

Author Profile

Claim This Author Profile

Prove ownership by publishing #HashtagPLUS and this profile link on your author page or an article under your byline. A moderator or admin will review the request before it merges into your real HashtagPLUS username.

0 karma0 postsjoined about 6 hours ago

How long until a rented GPU runs CUDA? Launch to first matmul on six GPU types, timed

🌐 dev.toSource

Six single-GPU machines launched through an API, timed from create call to first SSH and first CUDA matmul. 3 to 12 minutes, and why.

#devtopytorch #devto #dev #torch #time #first #runcrate #running

about 6 hours ago

4 GPUs, 2x speed: why PyTorch DDP stalled on a PCIe-only 4x RTX A6000, and two flags that took it to 3.6x

🌐 dev.toSource

Plain DDP on a rented 4x RTX A6000 gave 2x. Measured all-reduce bandwidth, then bf16 gradients and accumulation took it to 3.6x. Commands inside.

#devtopytorch #devto #dev #gpus #124m #355m #four #model

about 6 hours ago

Menu

Runcrate