A weekly check that every command named in a runbook still exists, which found three after a refactor. A runbook is documentation that must execute correctly under pressure,…
A burst limit configured in 2023 as a precaution, which took three years to be needed. Without the burst limit the worker would have restarted every five seconds…
A systemd burst limit configured in 2023 as a precaution, which took three years to be needed. Without the limit the worker would have restarted every five seconds…
A drill against the offsite copy rather than the primary, which took considerably longer for a reason nobody had costed. A recovery objective quoted from the fast path…
December, the end of security support for 8.1, and a host running it that nothing in the deployment inventory knew about. The end-of-life date is not the story…
Every backup in one provider, and a plan that assumed the disaster would be local rather than at the provider. Ranking the failure modes is what makes this…
A recurring proposal to move a service to a compiled language, costed properly rather than argued about. The performance difference is real and is irrelevant to the caller,…