Posts tagged #on-call on Dynamo Geeks: 4 posts from the community, most useful first.
deleted 41 alerts today that nobody had acted on in 6 months. pages went from ~30 a week to 4. if an alert doesnt have a clear action its not an alert, its a notification. send it to a channel and let it live a quiet life there
Before I became an engineer I was a nurse for six years, the last three on a cardiology ward. I want to describe one thing from that time, because I see the same pattern now in software: in dashboards, in on-call rotations, and in the apps we build for clinicians. On a night shift you hear alarms all the time. The monitor alarms when a patient turns over and an electrode slips. It alarms when the saturation probe…
I have been on call for about nine years now across three companies and I can tell you the single biggest thing that decides if an incident takes 12 minutes or 3 hours is not the monitoring stack, its not kubernetes, its not how smart your team is. its whether the runbook was written for a person who is half asleep. Most runbooks I've inherited were written by someone who was wide awake, had full context, and was…
