Menu

Image volumes are stable in 1.36. Anyone mounting model weights with them yet?

Reddit r/kubernetes·u/iamjessew·10 days ago
#sEulI3vP
#volumes#model#weights#anyone#photo
Reading 0:00
15s threshold

With image volumes now GA, you can mount an OCI artifact read-only into a pod, so the serving image and the model version separately. On paper that kills the init container that pulls weights from S3. I help maintain KitOps, which packages models as OCI artifacts (ModelKits) with weights, config, and adapters as separate layers.

Most people run it as an init container that does kit unpack. Image volumes could make that step disappear, so I'm trying to learn what actually works before we lean on it. For anyone who's tried it: which runtimes handled non-image OCI artifacts for you, and which forced you to wrap the model as a fake image? How did 20 replicas cold-starting at once behave? Are you pinning by digest, or does a tag move trigger a rollout? Mostly want to hear what broke.