I've just pushed a minor change to our infrastructure configuration for #MastodonAppUK and #Universeodon - I'm hoping this should fix some of the weird issues we've seen around IPv6 and it does mean that if our primary HAproxy server does go down for any reason the secondary server will take on the IPv6 connectivity as well.

I do need to look and see if I can do something smart to cover some IPv6 monitoring as right now IPv6 can silently fail and the site will still show as fully healthy.

Just as a bit of notice for #MastodonAppUk and #Universeodon folks

There will be an outage later this evening to facilitate the work I need to do here at the dc. Hoping it won't take too long and I'll let folks know when I have an idea on time.

I'm just waiting now for a dc staff member to let me through the front gate as it's a weekend so nobody's normally here 😂

It looks like I'm going to need to drive up to the DC now because I can't reasonably apply my fix remotely without risking breaking everything and having to go up there anyway.

For folks here on #MastodonAppUK and #Universeodon if you'd like to chip in to support my growing coffee addiction with the nonsense that is servers and kit breaking I would always appreciate it.

One Off / Monthly on Ko-Fi: https://ko-fi.com/mastodonappuk

And monthly support on Patreon: https://www.patreon.com/universeodon

The support is really appreciated and allows me to continue investing in the hardware and resources required to keep the sites online and with the continued goal now of removing dependencies on external parties.

It looks like the connectivity issues between #Universeodon and #MastodonAppUK are at least in part due to SideKiq and IPv6.

I've disabled IPv6 on SideKiq for the time being to at least let me try and get things back operational.

For now though it's very much past my bedtime and I need sleep!

We're having some major issues this evening across #MastodonAppUK and #Universeodon due to connectivity issues with our primary gateway router at our data center.

I'm waiting on some network monitoring info from our ISP but I'm starting to suspect this may be some sort of attack as I can't think of any other reason our router would be seemingly crashing regularly.

It seems as if the device comes online for a few seconds and then drops back off the internet.

Thankfully it doesn't seem to be actively impacting the sites themselves but our content processing is currently almost entirely offline due to issues with outbound connectivity.

We may be seeing some network related issues across #MastodonAppUK and #Universeodon

I'm keeping an eye but our router is currently unresponsive.

The status page will be updated should we actually see connectivity drops - https://status.atlas-media.co.uk

Just a note, we have added the following domains to our #Fediblock list across #MastodonAppUK #Universeodon and #MedMastodon

- privacysafe.social
- privacymatters.pro

Both domains have had more than a few recent reports which no action have been taken by the instances with relation to misinformation / anti-vax content and in the case of the second domain transphobia.

I've had a few reports that #MastodonAppUk and #Universeodon are playing up again with IPv6 since the maintenance I had to do yesterday which involved a full reboot of all our servers.

I'm fairly busy with other commitments today but will take a look when I can.