Masto.hostThere is currently an incident, and database servers 11, 22 and 23 stopped responding. Instances using those servers are down. I apologize for the disruption. I'm trying to gather more information and will update as soon as I know more.
OK, the problem has been identified in the data center: https://bare-metal-servers.status-ovhcloud.com/incidents/dgksqhl6lswj
Database server 23 is responding again.
Database servers 11 and 22 still down.
Database servers 11 and 22 still down.
Database server 11 is now also back online. Only database 22 still down.
Latest update from OVH:
"All services in room GRA0404 are now available again.
We are actively working to restore the servers in room GRA0406." - https://bare-metal-servers.status-ovhcloud.com/incidents/dgksqhl6lswj
Hopefully, the database server 22 should be back online soon.
Really sorry for the long downtime.
Another update "Less than five per cent of the services in rooms GRA0406 are still unavailable.
We are working hard to restore the remaining servers in both rooms."- https://bare-metal-servers.status-ovhcloud.com/incidents/dgksqhl6lswj
We are working hard to restore the remaining servers in both rooms."- https://bare-metal-servers.status-ovhcloud.com/incidents/dgksqhl6lswj
The incident has been resolved and instances that were affected by the database server outage are back online.
I'm extremely sorry for the long downtime.
This was a data center issue completely outside of my control. You can see the full details at: https://bare-metal-servers.status-ovhcloud.com/incidents/dgksqhl6lswj
Timelines will take a while to catch up but all should be good now.
Please let me know if you experience any further issues. Thanks 🐘
Marty Heyman @ Symas@mastohost Thanks for the updates. SH*T happens.