I've also set some IP (instead of DNS) monitors up in UptimeKuma. This lets me know of actual connectivity/routing (over tailscale) issues vs temporary authoritative DNS lookup over tailscale issues. #SRELife . Sigh. I wish UptimeKuma had UDP/NTP monitoring. Librenms will be making a comeback this week to cover the few things UptimeKuma/Beszel dont.

If your uptime depends on
“nothing weird happening”
I have bad news about production knowing it’s Friday.
🍬 Skittles is coming.
🌈 Taste the Rainbow.
⚓ Fix the architecture.

#SRELife #ChaosEngineering

@vitaut Be glad its only users and not developers themselves lol #srelife

@Disputatore @Ailantd yeah, I imagine such trips in a similar way I currently work: grunt work (or in the pilot's case, their hobbies) interrupted by alarms to solve something. #SRElife

Sometimes I dream of attending a low traffic store so I can dedicate my down time to hobbies (they mostly involve computers), but if it's low traffic it means that's bleeding money and I wouldn't be able to make a living of it.

One of my coworkers just posted this link to our team channel, totally made my day.

https://youtu.be/ia8Q51ouA_s?si=QGKTvbNCfzZNeZvo

Better yet, the site is live at https://srenity.online

I might just leave this running on the TV 24/7...

#DevOps #SRE #DevOpsLife #SRELife

Positive Affirmations for Site Reliability Engineers

YouTube

I've been a "Region Lead" at work for almost two years now. In practice, this is an Operations lead/coordinator, and has taken up 110% of my time at work (*slight* exaggeration :D ), but I have not really been involved in anything else.

I'm starting to feel it with having a lack of understanding of the actual function of operators we're creating. I've been too removed from the coding side of things. It's amazing how quickly things "move on" if you're not involved directly.

#sre #srelife

Sometimes you get to be criminal, victim, law enforcement officer, prosecutor, defense counsel, judge, jury, and executioner all in the course of one #bug. I should have known it was me when I encountered the word REDACTED in a place where I wasn’t expecting it. #srelife

Me: my VPN on my phone no longer works
IT: why do you need the VPN on your phone?
Me: I am oncall 24x7 in perpetuity
IT: OK

#SRE #SRELife

Livin' that ops life, which means I get to wake up for a 2:30am operation to take the database offline and resize it during our traffic nadir. 😎

Wish me luck!

#OpsLife #Ops #CloudOps #SRE #SRELife

We are living in 2022. We no longer brag about uptimes we brag about no downtimes. #SRELife