Two of our three servers decided to restart at around 04:00 CEST today. This caused Codeberg to be offline for several hours. We have restarted the servers and all services should be working again. We are currently investigating why these servers decided to restart themselves.
Our downtime earlier today was caused by a short power loss in the data center. Our contacts at our data center informed us that this has happened before and the needed modernization of power distribution to avoid such issues going forward is scheduled to take place within the next months.
@Codeberg Thank you for everything.
@Codeberg Unusual for two servers at once, but: Maybe a hardware failure (memory)?
@mtdu @Codeberg Very unlikely. My money is on a rogue crontab or the hoster kicking an entire rack/row by messing with the power distribution.

@mtdu @Codeberg

My first guess would be power supply problems. Brownout p.e.

@Codeberg thanks for your hard and valuable work. Hope you will find the problem fast.
@Codeberg Server Restart Enjineer — new job title 😆
@Codeberg Just ask them nicely not to do it again.
@Codeberg been there done that got the t-shirt. Rock on ! thanks for your spendiferous work in this regard. I am starting to really like Forgejo and more so what it stands for. #coders #forge #fediverse #activitypub
@Codeberg Machines starting to decide their own fate...
Is's not good... 🫣

@Codeberg Are there other issues left? I could log on to the service but that's about it.
Documentation and the blog are working fine but the dashboard, no, that still seems to have problems. At least for me they have.

(Edit: I found out it had to do with Firefox itself. However, I had no issues using Zen Browser. Strange...)