lemmy.one is suffering an extended outage - lemdit.com

lemmy.one has been down for a while now. I’ve personally noticed that it hasn’t been working for over 24 hours, some comments suggest it may be longer than that: [https://lemdit.com/pictrs/image/2036cec9-edbc-455f-9209-1a9fcdf4a39e.png] lemmy.one is one of the larger Lemmy instances, with around 7.3k users [https://the-federation.info/node/details/49982]. The site does load, however it displays a Lemmy error. This shows that the Lemmy UI is still there and working, but the Lemmy back-end server process is not. Based on this, it doesn’t look similar to the disappearance of vlemmy.net [https://lemdit.com/post/38958] and it’s most likely just a technical issue. #### So what is going on? My guess is there are 3 likely scenarios for what went wrong: - The Lemmy server process crashed (it’s known to happen from time to time) - This is an update gone wrong (the latest Lemmy update in particular is tricky as it requires a DB migration). - Some other mysterious event messed up the DB This is a very long time to be struggling with a technical issue and the lack of communication is concerning. It could be that: - The admin is just not available to deal with it right now due to real life reasons. - The DB is now a mess and the Lemmy server process can’t be restarted. I expect they have regular DB back-ups like everyone else and would’ve rolled back to a previous snapshot by now. I think the most likely scenario is that the admin just isn’t available to deal with it. To fix this requires actual server access, so even though lemmy.one had several Lemmy admins, it’s unlikely that all of them have the required access to deal with this issue. It would be interesting to hear if anyone managed to get in touch with lemmy.one’s admin.