Menu

Why Docker Can’t Use Your Mac’s GPU — and How to Pool Apple Silicon Macs for LLMs Instead
📰

Why Docker Can’t Use Your Mac’s GPU — and How to Pool Apple Silicon Macs for LLMs Instead

DEV Community: ansible·lucanu·3 days ago
#ZpjJwt3o
#devtoansible#devto#dev#llama#model
Reading 0:00
15s threshold

Correction (October 2026): an earlier version of this post described a Docker-based "unified GPU pool" on Apple Silicon. That doesn't work: Docker on macOS can't use the Apple GPU. The post below has been rewritten to describe the setup that actually works, which is also what the kit contains.

You have two or three Apple Silicon Macs sitting idle — a Mac Studio, a MacBook Pro, an M1 Mini. Their unified memory is great for running LLMs, so the obvious idea is to pool them. And the obvious first step most tutorials take is Docker.

On a Mac, that's a dead end for inference.

Why Docker can't use the Mac GPU

Docker Desktop, Colima and OrbStack all run your containers inside a Linux virtual machine . That VM has no access to Metal, Apple's GPU API, and there is no GPU passthrough for Apple Silicon like --gpus all on an NVIDIA Linux box.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.