Menu

#Pytorch

49 posts

Feed·
20 of 49 posts
Gemma 4 on a 4 GB GPU in Plain PyTorch: From Out of Memory to Faster Than llama.cpp
📰
0Read More

Gemma 4 on a 4 GB GPU in Plain PyTorch: From Out of Memory to Faster Than llama.cpp

DEV Community: pytorch·xbill·2 days ago
#mal3JuAW
#devtopytorch#devto#dev#pytorch#llama

On a 4 GB GTX 1650 Ti, Gemma 4 E2B does not fit in 16-bit, and Transformers' own 4-bit path runs out of memory on its first forward pass. Kept in Google's QAT 4-bit end to end, with a few Triton kernels and a CUDA graph, plain PyTorch decodes at 88 tok/s,…

15s
Now Open Source: TorchTPU and the TPU Agent Suite for Native PyTorch on Google Cloud TPUs
📰
0Read More

Now Open Source: TorchTPU and the TPU Agent Suite for Native PyTorch on Google Cloud TPUs

DEV Community: cloud·Keelin McDonell·4 days ago
#yDJCUkvZ
#devtocloud#devto#dev#pytorch#agent

We’re excited to share that TorchTPU—our native PyTorch stack for Google Cloud TPUs—is now open...

15s
PyTorch vs. TensorFlow for Diffusion Models: A Dev Leader's Guide to Tooling and Productivity
🖼️
0Read More

PyTorch vs. TensorFlow for Diffusion Models: A Dev Leader's Guide to Tooling and Productivity

DEV Community: tensorflow·Oleg·5 days ago
#QlmbCM58
#devtotensorflow#devto#dev#state#models

The Great Debate: PyTorch vs. TensorFlow for Diffusion Models In the rapidly evolving...

15s
Amazon Opens TorchNeuron to Run PyTorch Code on Its Trainium AI Chips
🖼️
0Read More

Amazon Opens TorchNeuron to Run PyTorch Code on Its Trainium AI Chips

#webpronews#news#amazon#trainium#pytorch

Amazon has opened TorchNeuron, software that runs existing PyTorch code on its Trainium AI chips after a simple configuration change, as a public beta and is open-sourcing it at the PyTorch Conference on Oct. 20.

15s
Google Open-Sources TorchTPU and Ships llm-d 1.0 for Kubernetes AI Inference
🖼️
0Read More

Google Open-Sources TorchTPU and Ships llm-d 1.0 for Kubernetes AI Inference

#webpronews#news#google#torchtpu#pytorch

Google open-sourced TorchTPU, its native PyTorch stack for TPUs, and released llm-d 1.0, a Kubernetes-native distributed inference stack co-founded with Red Hat, IBM and others, at PyTorch Conference 2026.

15s
AWS's TorchNeuron Runs PyTorch on Trainium With .to('neuron'). Shapes Must Be Static
🖼️
0Read More

AWS's TorchNeuron Runs PyTorch on Trainium With .to('neuron'). Shapes Must Be Static

DEV Community: pytorch·Gabriel Anhaia·5 days ago
#A8nmSHMU
#devtopytorch#devto#dev#torch#neuron

AWS open-sources TorchNeuron on October 20: Trainium becomes a normal PyTorch device. The beta wants static shapes, pinned versions and PyTorch 2.14.

15s
Google and Amazon bring AI applications to their chips without rewriting code
🖼️
0Read More

Google and Amazon bring AI applications to their chips without rewriting code

DEV Community: pytorch·Hacks.gr·5 days ago
#aBt75K8n
#devtopytorch#devto#dev#applications#pytorch

TorchTPU is Google’s open-source project for running PyTorch applications on its Tensor Processing Units without rewriting application code. Announced on 2

15s
Google has joined Amazon in attacking Nvidia's stronghold with AI app developers
🖼️
0Read More

Google has joined Amazon in attacking Nvidia's stronghold with AI app developers

DEV Community: pytorch·Chandan Kumar·5 days ago
#5N1UEmIS
#devtopytorch#devto#dev#google#nvidia

Google's new PyTorch porting tool competes on migration cost rather than FLOPS, and that shifts how teams should evaluate non-Nvidia...

15s
Google Open-Sourced TorchTPU. PyTorch/XLA Is Deprecated and Gets Archived November 15
🖼️
0Read More

Google Open-Sourced TorchTPU. PyTorch/XLA Is Deprecated and Gets Archived November 15

DEV Community: pytorch·Gabriel Anhaia·5 days ago
#Pv4bxjhq
#devtopytorch#devto#dev#pytorch#google

TorchTPU runs PyTorch on TPUs via device='tpu'. PyTorch/XLA is deprecated, its repo archived Nov 15. What to port, and what to check first.

15s
TorchTPU vs CUDA: Can Native PyTorch Make Google TPUs Easier to Use?
🖼️
0Read More

TorchTPU vs CUDA: Can Native PyTorch Make Google TPUs Easier to Use?

DEV Community: pytorch·jamilxt·5 days ago
#Sq87KSnq
#devtopytorch#devto#dev#google#pytorch

A PyTorch model can be portable in the way a recipe is portable: the ingredients and steps look...

15s
Hugging Face: Deep Dive into PyTorch MLP Fusion for Performance Optimization
🖼️
0Read More

Hugging Face: Deep Dive into PyTorch MLP Fusion for Performance Optimization

DEV Community: ai·nidalz954-lgtm·4 months ago
#SnSaVm7h
#dev#pytorch#performance#fusion#optimization

Hugging Face has published a technical article detailing the process of fusing Multi-Layer Perceptrons (MLPs) in PyTorch. This second part of a series

15s
Shai-Hulud Malware in PyTorch Lightning: What Actually Happened and How to Check Your Environment
🖼️
0Read More

Shai-Hulud Malware in PyTorch Lightning: What Actually Happened and How to Check Your Environment

DEV Community·우병수·6 months ago
#JTuwZxdL
#whats#ai#lightning#pytorch#install

Discover how malicious code named Shai-Hulud was embedded in packages targeting the PyTorch Lightning ecosystem. Learn about the risks and steps to check your environment for this specific attack vect

15s