Menu

#Offloading

5 posts

Feed·
5 of 5 posts
Reducing High-Bandwidth Memory Bottlenecks in JAX-Based LLM Training with Host Offloading
🖼️
0Read More

Reducing High-Bandwidth Memory Bottlenecks in JAX-Based LLM Training with Host Offloading

NVIDIA Technical Blog·Tanya Lenz·about 5 hours ago
#Z1E9hhMs
#developer#offloading#host#memory#batch

Large language model (LLM) training workloads increasingly run into GPU memory limits before compute is fully used. Model weights, gradients, optimizer states…

15s
What if robots didn't need all their AI onboard?
🖼️
0Read More

What if robots didn't need all their AI onboard?

Microsoft Research Blog - Microsoft Research·3 days ago
#YS26eYdR
#microsoft#news#inference#robot#physical

Robots are getting smarter, but how can their hardware match that growth? New Microsoft Research findings show that moving AI inference beyond the robot can improve task success, boost efficiency, and support more advanced physical AI workloads.

15s
What if robots didn't need all their AI onboard?
🖼️
0Read More

What if robots didn't need all their AI onboard?

Robots are getting smarter, but how can their hardware match that growth? New Microsoft Research findings show that moving AI inference beyond the robot can improve task success, boost efficiency, and support more advanced physical AI workloads.

15s
Beyond Cognitive Surrender: Debugging Is the Skill That Keeps AI From Owning You
🖼️
0Read More

Beyond Cognitive Surrender: Debugging Is the Skill That Keeps AI From Owning You

DEV Community·果物リン·5 months ago
#aFJuhgGn
#where#ai#productivity#cognitive#brain

A developer's field guide to the line between cognitive offloading and cognitive surrender — and why debugging skill is the real test.

15s