Node under disk pressure
Node condition DiskPressure, image and container garbage collection runs.
ImpactPods evicted, new pods cannot start
Can it be seen coming?Yes
RupturaNot covered yet
How to detect it
DiskPressure True.
Metrics and signals to watch:
kube_node_status_condition DiskPressurenode_filesystem_avail_bytes
Can you see it coming?
Yes Precursor: Node filesystem filling.
What it hits next
every pod of the node.
What to do
Clean images and logs, or grow the disk.
Sources
- Kubernetes node condition DiskPressure
Where Ruptura stands
Ruptura does not cover this failure yet. The card is here so you know it exists and how to detect it.
Related failures
- Node not ready
- Node flaps between Ready and NotReady
- Node under memory pressure
- Node under PID pressure
- Node filesystem filling up
See it coming instead of reading about it
Ruptura is an open-source operator for Kubernetes and OpenShift that predicts the failures in this catalog that can be predicted, detects the others, and sends them to Alertmanager. Watch an OOM crash predicted 21 minutes early · ★ GitHub
Ruptura is an open-source operator for Kubernetes and OpenShift that predicts the failures in this catalog that can be predicted, detects the others, and sends them to Alertmanager. Watch an OOM crash predicted 21 minutes early · ★ GitHub