Menu

Running soci, stargz or nydus? containerd 2.5 finally puts a deadline on proxy snapshotter calls

Reddit r/kubernetes·u/Fabulous-Confection6·17 days ago
#DWj6Nv7z
#containerd#plugin#call#snapshotter#deadline
Reading 0:00
15s threshold

A node of ours stopped starting pods for hours while it reported Ready. The root cause: containerd's snapshot GC called a proxy snapshotter plugin (soci in our case) with no deadline, the plugin stopped answering, and GC sat on a lock that everything else on that snapshotter needed. Nothing times out, so nothing recovers.

What changes: containerd now has a default_timeout on proxy plugins. Every call containerd makes to the plugin gets that deadline when the caller didn't set one. That covers all 10 snapshotter calls, not only the GC path.

[proxy_plugins.customsnapshot] type = "snapshot" address = "/var/run/mysnapshotter.sock" default_timeout = "30m"

Things to know before you set it:

It's merged on main (containerd#14187) and ships in 2.5, planned for January 6. Not in 2.4.

Pick a value well above your slowest healthy call. A call that hits it fails.

Without it, a wedged plugin can hold its lock for good.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.