Queer SupervillainessMay 30, 2017

I can't fall asleep.

Why? I'm very hungry.

Why? It turns out I probably only ate once between Wednesday and Friday, which explains my appetite this weekend.

Why? Because I had no energy and no in-person social contact.

Why? Because I returned from a 3-month stay in the US a week ago, resulting in no recurring social events, tons of jetlag, and massive allergic reactions.

Why? Because of planning failures: no sleep and allergy meds on hand, no scheduled social things.

#5whys

Show threadQueer SupervillainessMay 30, 2017

Currently deploying a quick-fix: fleckerln & goulash.

A choice 4am snack.

Show threadQueer SupervillainessMay 30, 2017

4.07am First build of the hotfix is out.

Feedback from QA: too hot, not enough salt.

Curently live-patching.

Show threadQueer SupervillainessMay 30, 2017
4.09am Live-patched version passed QA, now deploying.
Show threadQueer Supervillainess
4.12am, deployment in progress (50% of bowl 1 done), first end-user feedback: it's good and properly spicy, despite looking like fleckerln with gulash-like sauce.
May 30, 2017 at 2:13amWeb
Show threadQueer SupervillainessMay 30, 2017
4.15am: Note from ops: Only bowl 1 was patched and tested by QA. Inssuficient salt in bowl 2, applying the patch now.
Show threadQueer SupervillainessMay 30, 2017
4.22am Deployment 75% done.
Projections put us bellow SLOs (either < 8h of sleep, or wakeup after 12pm), hence CCing ${product_owner} to the thread.
Show threadQueer SupervillainessMay 30, 2017

4.27am Deployment done, production systems report green (“tummy full of warmth & spices”).

Setting an alert for the `sleep.sh` cronjob not starting within 2h, moving temporary hacks to the sink for later cleanup, and closing the incident.

Show threadQueer SupervillainessMay 30, 2017

Since I was asked: yes, fantasy-me has a fantasy-cron that notifies the fantasy-monitoring when jobs start and terminate (along with exit status).

Also, fantasy-me picked 2h so someone else would be on-call by then. =^.^=