Menu

#Torch

75 posts

Feed·
20 of 75 posts
torch.cuda.is_available() Returns False on RunPod: What It Means and What To Do Before Billing Starts
📰
0Read More

torch.cuda.is_available() Returns False on RunPod: What It Means and What To Do Before Billing Starts

DEV Community: pytorch·Francisco Booth·2 days ago
#PoScZQrG
#devtopytorch#devto#dev#torch#cuda

You SSH into your pod. You run your training script. The loss starts printing. Everything looks...

15s
How do you fix CUDA out of memory errors in PyTorch?
🖼️
0Read More

How do you fix CUDA out of memory errors in PyTorch?

DEV Community: pytorch·Viswaretas Kotra·4 days ago
#1ibrEuuJ
#devtopytorch#devto#dev#memory#batch

Read what the OOM error says, then cut the biggest consumer: activations, optimizer state or fragmentation. An ordered checklist with GB math and code.

15s
Build and Verify Chunked Cosine Search with Python and PyTorch on a Rented GPU
📰
0Read More

Build and Verify Chunked Cosine Search with Python and PyTorch on a Rented GPU

DEV Community: pytorch·CloudGPU·7 days ago
#XRueKei0
#devtopytorch#devto#dev#torch#device

A seeded Python fixture, blockwise GPU top-k search, and a float64 CPU oracle for checking vector retrieval.

15s
Why does my PyTorch DataLoader fail when a worker touches CUDA?
📰
0Read More

Why does my PyTorch DataLoader fail when a worker touches CUDA?

DEV Community: pytorch·CloudGPU·7 days ago
#ROK2tX6P
#devtopytorch#devto#dev#cuda#dataset

I work on CloudGPU. Keep dataset decoding and collation on the CPU, then move each batch to CUDA in...

15s
Reproducing a paper in Python: a random seed is only the first step
📰
0Read More

Reproducing a paper in Python: a random seed is only the first step

DEV Community: pytorch·wanqiuxu·8 days ago
#MEMBOVQe
#devtopytorch#devto#dev#seed#random

You follow a machine learning or experimental paper, run the code, and the loss curve or the reported...

15s
BF16 FP8: checking precision across two CPU compiler versions
📰
0Read More

BF16 FP8: checking precision across two CPU compiler versions

DEV Community: pytorch·Blucca·11 days ago
#7Xf9Lnwi
#devtopytorch#devto#dev#torch#fp32

A dtype conversion can remain visible after the final FP8 quantization. It belongs in a fusion's...

15s
Silent NaN: the check that belongs in every diffusion pipeline
📰
0Read More

Silent NaN: the check that belongs in every diffusion pipeline

DEV Community: python·mujin·15 days ago
#Mwm4z8go
#devtopython#devto#dev#file#fp16

I generate 512x768 images on a 4GB GTX 1650. About 150 seconds per image in fp32 with model offload....

15s
Gemma 4 in Rust on TorchTPU: Hands On With Colab
📰
0Read More

Gemma 4 in Rust on TorchTPU: Hands On With Colab

DEV Community: pytorch·xbill·16 days ago
#Jpe0kZH8
#devtopytorch#devto#dev#rust#python

A Rust crate reads the checkpoint, runs all 35 layers of Gemma 4 E2B and drives the decode loop on one TPU v5e chip in Colab, with every operation a TorchTPU kernel and the same tokens as compiled Python.

15s