Raise your hand if you ever inadvertently caused a 2+ hour outage (which was impossible to fix in a deterministic manner) due to DNS misconfiguration. #itwasdns
@geerlingguy The network was *hallucinating*.
@geerlingguy ive once unsplit the horizon on a dns system... the results were poor...
@geerlingguy does Red Shirt Jeff work at Amazon by any chance??

@geerlingguy My first thought upon hearing "it was dns" was you and your shirt.

Also my first thought the last hundred times something broke in the homelab and it turned out to be DNS.

@geerlingguy it's not DNS, it's not DNS.... It was DNS
@geerlingguy I mean, sure, but then I fixed the configuration and restarted the Mac mini.
@geerlingguy me few weeks ago.. Why are backups from my parents house not running?... For some reason DNS server started replying with public IP for my domain instead of internal IP for subdomain of the backup server... I'm to blame for how questionably whole things was setup, but still.. DAMN YOU DNS
@geerlingguy ok, but I want to know about people that have done it deliberately
@geerlingguy mine was more of a "I decommissioned this domain because it was the potential name of our company eight years ago, so surely we aren't using it anymore..!"
@geerlingguy Here, but I still blame Vodafone

Does it count when I recommended a DNS hosting provider who subsequently had a 2+ hour outage and we couldnโ€™t even end the outage by moving to another provider because NS records from the TLD had a 24 hour TTL?

Ultimately we switched to managing our own DNS servers with replicas at 4 different hosting providers. That new setup has now run for over 10 years without a single outage.

@geerlingguy I'm digging through old mails of mine for a talk next week ... about 30% of them have to do with DNS screw-ups ... and this is in 91/92 :๐Ÿ˜Ž
@geerlingguy Always it was DNS ๐Ÿ˜ฉ
@geerlingguy all my most recent problems have been caused by storage being full. Harder in the cloud, I guess.
@geerlingguy โœ‹ Since realising itโ€™s always DNS, downtime has been reduced measurably though ๐Ÿ˜‚
@geerlingguy It's always the cables, access-rights or DNS.

@geerlingguy

Oh hey I literally just did this for the first time last week!

I'm in the club!

@geerlingguy
Nope, but I have had DNS cause email issues for 2 months.
@geerlingguy I haven't yet, but I tend to blame #DNS for a lot of issues...
@geerlingguy I only messed up company emails and they all would end up in spam everywhere else.
@AubreyDeLosDestinos oops yeah, one time sent an email with the subject and body "Test." to prod instead of test mailing list... 18,000 emails later...
@geerlingguy A reminder to use boring texts for these tests. Imagine sending a spicy in-joke.
@geerlingguy fun fact: I'm doing major work on DNS in my org and I got really nervous as I got messages relayed that stuff wasn't working :D but yes, I can also raise my hand along with the others