Node under PID pressure
Node condition PIDPressure.
ImpactNew processes and pods cannot start
Can it be seen coming?Yes
RupturaNot covered yet
How to detect it
PIDPressure True.
Metrics and signals to watch:
kube_node_status_condition PIDPressure
Can you see it coming?
Yes Precursor: Process count growing on the node.
What it hits next
every pod of the node.
What to do
Find the pod that leaks processes and set PID limits.
Sources
- Kubernetes node condition PIDPressure
Where Ruptura stands
Ruptura does not cover this failure yet. The card is here so you know it exists and how to detect it.
Related failures
- Node not ready
- Node flaps between Ready and NotReady
- Node under memory pressure
- Node under disk pressure
- Node filesystem filling up
See it coming instead of reading about it
Ruptura is an open-source operator for Kubernetes and OpenShift that predicts the failures in this catalog that can be predicted, detects the others, and sends them to Alertmanager. Watch an OOM crash predicted 21 minutes early · ★ GitHub
Ruptura is an open-source operator for Kubernetes and OpenShift that predicts the failures in this catalog that can be predicted, detects the others, and sends them to Alertmanager. Watch an OOM crash predicted 21 minutes early · ★ GitHub