One of the RAID disks in the database server 5 failed and it needs to be replaced as soon as possible.

I requested the replacement and expect it to be done in the next couple of hours. This requires the server to go offline but it should take less than an hour.

I will update here once the intervention starts/finishes.

Only instances using the Database 5 will be impacted (see the database server in your Masto.host account).

Sorry for the inconvenience. This week servers decided to act up :|

The intervention in Database server 5 is about to start.
Database server 5 went offline about 5 minutes ago and the disk is being replaced now.

There is a problem with the disk replacement that is causing the server not to boot. They are trying to understand what could be causing the problem.

I am really sorry but it's something that I have no access to and will have to rely on the information I am provided, causing me to provide timings and have expectations that are inaccurate.

I'm contacting everyone I can to obtain more informations and ways to speed up the process.

Massive SNAFU! I can't apologise enough but it was not on my end.

The old drive stored the EFI and that is required to boot the server. The person that did the disk replacement didn't know that (EFI cannot be on the RAID), so they were hours attempting to reboot the server without EFI, until they gave up and handed me the broken server.

Now, an attempt will be made to place the old drive back and see if the server boots like that and then I can fix the situation.

@mastohost Ooof… it’s no fun trying to fix someone else’s IT fix that went sideways. I’m not affected in this incident, but we all really appreciate everything you do for us!
@mastohost 😱 May the fix go smoothly!
@mastohost Thanks for working to save the situation. I know you are neck deep in this, but it would be great to have an update or an ETA.
@mastohost you’ve had a *day* but thank you for keeping everyone informed and I really appreciate you!