Menu

#Cuda

78 posts

Feed·
20 of 78 posts
How do you fix CUDA out of memory errors in PyTorch?
🖼️
0Read More

How do you fix CUDA out of memory errors in PyTorch?

DEV Community: pytorch·Viswaretas Kotra·about 23 hours ago
#1ibrEuuJ
#devtopytorch#devto#dev#memory#batch

Read what the OOM error says, then cut the biggest consumer: activations, optimizer state or fragmentation. An ordered checklist with GB math and code.

15s
Run Native DLA Inference in Python on NVIDIA Jetson AGX Orin Using cuDLA
🖼️
0Read More

Run Native DLA Inference in Python on NVIDIA Jetson AGX Orin Using cuDLA

NVIDIA Technical Blog·Nikshay Shrivastava·2 days ago
#IC7S1qAo
#developer#cudla#cuda#python#runtime

AI applications at the edge often need to run multiple neural networks within limited compute and power budgets. NVIDIA Deep Learning Accelerator (DLA)…

15s
Build and Verify Chunked Cosine Search with Python and PyTorch on a Rented GPU
📰
0Read More

Build and Verify Chunked Cosine Search with Python and PyTorch on a Rented GPU

DEV Community: pytorch·CloudGPU·5 days ago
#XRueKei0
#devtopytorch#devto#dev#torch#device

A seeded Python fixture, blockwise GPU top-k search, and a float64 CPU oracle for checking vector retrieval.

15s
Why does my PyTorch DataLoader fail when a worker touches CUDA?
📰
0Read More

Why does my PyTorch DataLoader fail when a worker touches CUDA?

DEV Community: pytorch·CloudGPU·5 days ago
#ROK2tX6P
#devtopytorch#devto#dev#cuda#dataset

I work on CloudGPU. Keep dataset decoding and collation on the CPU, then move each batch to CUDA in...

15s
GeForce 8800 GTX: Celebrating 20 Years Of Gaming And CUDA
📰
0Read More

GeForce 8800 GTX: Celebrating 20 Years Of Gaming And CUDA

#nvidia#redditnvidia#geforce#cuda#graphics

Few graphics cards have left a mark on PC gaming quite like the GeForce 8800 GTX, which hit shop shelves November 8th, 2006. To celebrate its 20th anniversary, we’re looking back at its gaming and CUDA legacy, and checking out “GeForce 8800 GTX - 20 Years…

15s
NVIDIA CUDA 13.5 Brings NVIDIA Vera Rubin GA Support
🖼️
0Read More

NVIDIA CUDA 13.5 Brings NVIDIA Vera Rubin GA Support

NVIDIA Technical Blog·Shara Tibken·11 days ago
#3DoZKJBH
#developer#cuda#nvidia#memory#tile

As artificial intelligence and accelerated computing continue to push the boundaries of what’s possible, the latest NVIDIA CUDA release arrives to unlock…

15s
Triton at the Core: Building Portable LLM Operator Libraries with FlagGems and Benchmarking Against Native CUDA
📰
0Read More

Triton at the Core: Building Portable LLM Operator Libraries with FlagGems and Benchmarking Against Native CUDA

DEV Community: ai·Tamiz Uddin·13 days ago
#3fTM82D2
#devtoai#devto#dev#triton#cuda

Build a portable LLM operator library with Triton and FlagGems, then benchmark it against native CUDA to quantify portability vs. performance trade-offs.

15s
How PyTorch Became the Socket Every AI Chip Plugs Into
🖼️
0Read More

How PyTorch Became the Socket Every AI Chip Plugs Into

DEV Community: pytorch·Dhruv Agrawal·19 days ago
#dPWi3GCt
#devtopytorch#devto#dev#pytorch#torchtpu

Google and AWS released PyTorch backends a day apart, both through the same small hook. Here's what that hook is, and why getting code to run on a new chip is the easy half.

15s
Two PyTorch ops that stopped a CUDA text model on an Apple GPU
📰
0Read More

Two PyTorch ops that stopped a CUDA text model on an Apple GPU

DEV Community: pytorch·Leo Newton·19 days ago
#49NS9T57
#devtopytorch#devto#dev#device#cuda

Next-Concept Modeling already used ordinary PyTorch attention. The Apple GPU run failed on float64 penalties and one area-pool whose lengths do not divide.

15s
CCCL Runtime: A Modern C++ Runtime for CUDA
🖼️
0Read More

CCCL Runtime: A Modern C++ Runtime for CUDA

NVIDIA Technical Blog·Piotr Ciolkosz·22 days ago
#gleEpVHA
#developer#include#cuda#stream#kernel

The NVIDIA CUDA Core Compute Libraries (CCCL) provides delightful and efficient abstractions for CUDA developers in C++ and Python. It features: This post…

15s
Kernel Fusion in NVIDIA CUDA: Optimizing Memory Traffic and Launch Overhead
🖼️
0Read More

Kernel Fusion in NVIDIA CUDA: Optimizing Memory Traffic and Launch Overhead

NVIDIA Technical Blog·Michelle Horton·22 days ago
#UTuwOrQD
#developer#cuda#kernel#fusion#memory

There are many ways to optimize code for GPUs. In this post, you’ll learn how kernel fusion can improve memory bandwidth and reduce kernel launch overhead…

15s