Good DevOps practice is to build your systems with failure in mind.

What you build *will* break. That's inevitable. So what you build should be built to be quickly recoverable.

You should have good disaster recovery plans.

You should have backups.

Your deployment should be automated, and use infrastructure-as-code extensively.

#DevOps #MastoAdmin

@aurynn and for your truly ancient legacy systems where spiders dwell, have some sort of break glass documentation for what to do when it does that thing it does once every 7 years because Terry (who knew how to soothe it) has left.
@annamal tested DR documentation is important
@aurynn especially in a disaster prone country :)