Apologies for the outage on phpc.social. Bit of an order-of-operations issue when attempting to start the Mastodon 4.2.0 upgrade. On the next attempt, we'll run OS package updates well *before* attempting the other parts of the upgrade.

Queues are catching up from the outage. Once those are caught up, I'll reindex search; we restored from a backup on the app server (database/Redis/file storage were not affected) so search will be a bit behind 'til we get that complete.

#MastoAdmin

@ian No worries here - I expected it was something like that. I did end up wondering, though: is there a status page URL for communication in the event of a major service outage? Something like status.phpc.social (or even on a different domain entirely, in case DNS is the problem)?

Looks like the main commercial providers I know of wouldn't help with the communication side of that, but perhaps this would: https://github.com/upptime/upptime #Upptime #UptimeMonitoring

GitHub - upptime/upptime: ⬆️ GitHub Actions uptime monitor & status page by @AnandChowdhary

⬆️ GitHub Actions uptime monitor & status page by @AnandChowdhary - upptime/upptime

GitHub
@kboyd Yeah, CNAME is the issue without bumping to the paid UptimeRobot tier (we have the free version set up at https://stats.uptimerobot.com/KvNlxHDwxO).
phpc.social status

@ian Would a paid OhDear account solve that issue? Do we need more than 5 domains?

/cc @kboyd

@heiglandreas @kboyd For monitoring/status page/alerts, paid Oh Dear should cover everything.

@ian @heiglandreas @kboyd

@freekmurze would ohdear be open to sponsoring an ohdear account for phpc.social?

@rskuipers @ian @kboyd @freekmurze If not, I can think of other options 😁
@rskuipers @ian @heiglandreas @kboyd yeah sure! I see that there was an account created that is monitoring that domain, I’ll mail a 100% discount coupon code that to the email on that account later today 👍

@freekmurze @mattiasgeniar Thanks for the generous sponsorship of #ohdear for the phpc.social server(s)! Much apprechiated!

/cc @rskuipers @ian @kboyd

@heiglandreas @mattiasgeniar @rskuipers @ian @kboyd It's our pleasure!

Without #PHP and it's awesome community, we couldn't have built Oh Dear 👍

@freekmurze @ian @heiglandreas @kboyd you're a legend. Thank you Freek 😊