A failing dependency takes its callers down
One workload fails and the services that call it start to fail.
ImpactAn application outage from one component
Can it be seen coming?Partly
RupturaCovered
How to detect it
Callers of a failing workload.
Metrics and signals to watch:
call graphfailures of each workload
Can you see it coming?
Partly Precursor: A predicted failure of the dependency, carried along the call graph.
What it hits next
the application.
What to do
Fix the dependency first, add timeouts and fallbacks in callers.
Sources
- OpenTelemetry service graph
Where Ruptura stands
Ruptura reports this failure. A pre-registered lab test is not published yet.
Related failures
See it coming instead of reading about it
Ruptura is an open-source operator for Kubernetes and OpenShift that predicts the failures in this catalog that can be predicted, detects the others, and sends them to Alertmanager. Watch an OOM crash predicted 21 minutes early · ★ GitHub
Ruptura is an open-source operator for Kubernetes and OpenShift that predicts the failures in this catalog that can be predicted, detects the others, and sends them to Alertmanager. Watch an OOM crash predicted 21 minutes early · ★ GitHub