this gem is from the #birdsite

@nixCraft Can definitely relate!

I generally ask people to provide photo's of what lights are on, you would not believe how many times they're off!

@nkukard @nixCraft Server with iLO chips are a godsent.
@Legion495 @nixCraft Very true! but so are clients that pay for them ;)
@nixCraft
Poor soul, he ain't got out-of-band.
@bersl2
@nixCraft Good Lord. Sounds about right.

@nixCraft
Been there:

Them: "But there was a blinking green light on the back!" [always-on Ethernet port link]

Me: "However, the red light in front, specifically labeled POWER, the one I asked you to look at, was off."

@nixCraft there's the old joke about being paid to know where the button is .¯⁠\⁠_⁠(⁠ツ⁠)⁠_⁠/⁠¯
@nixCraft I don't miss the days of being the only one who knew what a power button was. Though my first question was usually is it plugged in....

@nixCraft I'm reminded of a story from years ago that a remote IT person kept having to prioritize people's little tech support requests b/c they figured out "the server is down" got an immediate response.

They told the co-workers if the server was reported down in error again, they would have to pay $10 into a fund each time it happened and magically the server stopped being down so often.

@nixCraft @JessTheUnstill this is why I always asked the remote person to “turn it off and back on again” regardless of their insistence that “the power is on” because 90% of the time the person would “turn it off” and it would turn on and the person would say “oh I though it was already on!”

@nixCraft ...or a lesson of why setting up a good lights-out management solution is important.

(If you don't trust IntelME nor the buggy IPMI firmware, there even raspberrypi based solution that you can plus into your server).

@nixCraft
Yep.. I've never been sorry to get away from tech support role.
20-odd years ago now, 3 hour round trip to plug some effing speakers into the correct socket on the back of a PC. I'd not have minded quite so much if the plugs, and sockets, weren't colour coded, so it should have been bloody obvious.

I think this was at the third company this bloke had set up.. The previous ones had both gone bust. I assume his business skills were on a par with his colour-matching skill

@nixCraft to be fair, any decent modern server should have a BMC or “lights out” interface to do these things remote. Also containers :)
@nixCraft got a call from our 24/7 NOC at about 2am that a server was down. There’s literally a blizzard outside. Nobody on the road but me in my Smart car driving through over a ft of snow on the highway going maybe 5-10mph. Can’t see the lanes or road at all. The massive plows are behind me probably laughing their assess off…..
@nixCraft It took me 2 hours to go about 20-25 miles. Get to the Datacenter, can’t make it up the small hill that is the parking lot. I just leave my car on the hill and head in. I get inside and the server is completely fine. I get online and the NOC tells me they got it working about 15 minutes after I left my house. No phone call or text.