https://builder.aws.com/content/3Lu6BGwyRJoJ6dfIsMVaBmwZ4Z9/when-kubernetes-health-checks-lie-readiness-liveness-startup-probes-and-real-service-availability
Why healthy Pods can still deliver broken services, and how to engineer health checks that reflect production reality.
When Kubernetes Health Checks Lie: Readiness, Liveness, Startup Probes and Real Service Availability
A Kubernetes Deployment reports all replicas available. Every Pod is Running. Readiness probes are passing. The cluster dashboard is green.
Customers are still receiving HTTP 503 responses.
This is not necessarily a Kubernetes bug. It is a gap between what Kubernetes considers healthy and what users experience as available.
Kubernetes health probes answer specific operational questions. They do not establish end-to-end service reliability.
The problem begins when platform teams treat those answers as interchangeable.
A liveness probe cannot prove that an application can serve requests.…