Menu

Post image 1
Post image 2
Post image 3
Post image 4
Post image 5
Post image 6
Post image 7
1 / 7
0

Connection Storms and Orphan Locks: Why Your Lambda Outage Wasn't About Lambda

DEV Community·srinu madhav vysyaraju·4 months ago
#oMU8lKcJ
Reading 0:00
15s threshold

Series recap. Post 1 — Locking 101 for Serverless Devs covered the mental model: pessimistic vs optimistic locking, what each isolation level actually locks, and why short-lived functions amplify every locking pain point. Worth reading first — this post leans on it. In post 1, a thousand Lambdas queued on a single inventory row. That's the obvious failure mode — the kind you can almost see coming if you squint. Post 2 is about the one that actually wakes you up, because nothing in your dashboard says the word "lock": Lambda invocations: spiking, then flat-lining at the concurrency ceiling. Database CPU: 8%. Database connections: pinned at max. p99: timing out. Error rate: 100% on bookings, partial everywhere else. You restart the database. It works for ninety glorious seconds. Then it breaks again, the same way. That's a connection storm meeting an orphan lock. The lock is the actual cause. The connection storm is what turns it into a public incident with a postmortem doc attached.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.

Read More