John Regehrdid I just `kill --9 -1` on my laptop instead of the machine I wanted to be shelled into? I did, very nice
synlogic4242@regehr blame it on the chaos monkey
"It wasn't me. It was the chaos monkey. Test successful!"
@synlogic4242 I really should not be in the habit of issuing that command, it has caused trouble multiple times before. but it's just such a clean and easy way to kill off many-process experiments on remote machines
@regehr makes sense, agreed. OTOH theres another extreme opposite viewpoint on it which says that even if all projects start as pets they should evolve into cattle eventually. in cattle we dont want any SPoFs, for example, but also we should assume that anything that can go wrong in prod will eventually go wrong in prod. every possible edge case will happen, one day, perhaps at the worst possible time. thus, chaos engineering. the only way to know for sure if one's system can recover from X is to forcefully induce X and see what happens. granted killing all processes as root should not happen but... its possible. heck look at the flood of old Linux LPEs surfacing in recent months
@synlogic4242 yeah, but I don't have time to plan for the future. I can barely plan for the present.
@regehr lol. I hear you
Joseph C. Osborn@regehr My personal experience of this is trying to debug slow rendering in a graphical program. Desperately modifying code to get some output to change or debug print to fire, losing my grip on reality—and realizing that I’ve been running my program through x11 in a ssh session. That was a fun morning.
@regehr oh, and to clarify (on re-reading I realized I left out some context): the code I was modifying was on my laptop and the code I was running was on a different computer. So of course none of my changes did anything!
G. Wozniak@regehr Glad to have you back.
Jonathan Yu@regehr it's always a best practice to test things locally before you run them in production
mx alex tax1a - 2020 (6)
Ben Zanin
Chris Siebenmann
felix (grayscale) 🐺@regehr I give my shell prompt a different background color on remote machines, after I realized I don't really notice the hostname in my prompt.