API server errors or slow requests
5xx responses and request latency rise.
ImpactControllers, operators and deploys slow down or fail
Can it be seen coming?Partly
RupturaNot covered yet
How to detect it
Error budget burn.
Metrics and signals to watch:
apiserver_request_totalapiserver_request_duration_seconds
Can you see it coming?
Partly Precursor: etcd latency or request volume rising.
What it hits next
every controller and operator.
What to do
Find the noisy client or the slow etcd.
Sources
- kubernetes-mixin KubeAPIErrorBudgetBurn
Where Ruptura stands
Ruptura does not cover this failure yet. The card is here so you know it exists and how to detect it.
Related failures
See it coming instead of reading about it
Ruptura is an open-source operator for Kubernetes and OpenShift that predicts the failures in this catalog that can be predicted, detects the others, and sends them to Alertmanager. Watch an OOM crash predicted 21 minutes early · ★ GitHub
Ruptura is an open-source operator for Kubernetes and OpenShift that predicts the failures in this catalog that can be predicted, detects the others, and sends them to Alertmanager. Watch an OOM crash predicted 21 minutes early · ★ GitHub