instance changelog: iocaine, metrics, and the treat

https://awful.systems/post/6285778

instance changelog: iocaine, metrics, and the treat - awful.systems

3 days ago on the 12th I pushed a new version of the awful.systems infrastructure flake [https://codeberg.org/awful-systems/awful-systems] and our production ruggedized Lemmy fork [https://codeberg.org/awful-systems/philthy] to try and fix the problem where AI scrapers would come in and push over the instance, resulting in a bunch of 503s and general slowness. I’m happy to announce we’re now running with iocaine [https://iocaine.madhouse-project.org/], which seems to have fixed things nicely – though as always, let me know if anything seems off and ping me on Mastodon if the instance goes down. in addition to iocaine, I’ve added a suite of live metrics available to instance admins and moderators. if I haven’t sent you credentials for this yet and you think you should have them, shoot me a message. I apologize that these changes took me so long to get working, but I’m very happy they seem to be effective. I’ve also got some notes on running iocaine in production I can share with any interested parties, and I’ll be reaching out to iocaine’s developer with some suggestions around making it a little bit easier to work with, since at this point it’s a crucial part of running an independent web site. ## the treat is still in the oven

scheduled downtime: November 12 at 8 AM GMT [iocaine, better metrics, and eventually a treat]

https://awful.systems/post/6247946

[instance changelog] Lemmy 0.19.12, NixOS 25.05, Postgres 16

https://awful.systems/post/5455288

[instance changelog] Lemmy 0.19.12, NixOS 25.05, Postgres 16 - awful.systems

we’re finally on Lemmy 0.19.12! check out the changes here: - our infrastructure deployment flake [https://codeberg.org/awful-systems/awful-systems] - the frontend [https://codeberg.org/awful-systems/philthy-ui] - the backend [https://codeberg.org/awful-systems/philthy] here’s a quick summary of what changed: - our instance fork is now in line with the stable upstream version of Lemmy, 0.19.12. big shoutout to @froztbyte@awful.systems [/u/froztbyte@awful.systems] [https://awful.systems/u/froztbyte] for their significant labor in documenting the upstream changes we could expect from 0.19.3 to the new version, in figuring out what the stable version of Lemmy even is (the 0.20.0 and 1.0.0 series of releases don’t even talk to their own frontends), and to froztbyte, @fasterandworse@awful.systems [/u/fasterandworse@awful.systems] [https://awful.systems/u/fasterandworse], and @dgerard@awful.systems [/u/dgerard@awful.systems] [https://awful.systems/u/dgerard] for moral support during the upgrade process. - all our instance features merged fine into the new version (this, shockingly, wasn’t the hard part). - our Lemmy Nix module configuration has been moved out of the infrastructure repo, flakeified, and brought in line with the current state of the Lemmy NixOS module. in the process, I fixed two major bugs in the Lemmy NixOS module around secret handling and federation. I will not be upstreaming these changes because the Nix people like murderbots and fascists more than they like having contributors. - we’re now running on the latest stable NixOS, 25.05. - I’ve removed the infrastructure code for the now-unused staging instance; now we just have prod and dev. - we’ve migrated to PostgreSQL 16, the version currently in use by the Lemmy Docker container. as always, post here or in the testing thread if anything seems extremely broken

[testing] we made it to lemmy 0.19.12 but federation feels off

https://awful.systems/post/5399337

[testing] we made it to lemmy 0.19.12 but federation feels off - awful.systems

the good news: we’re now on the newest stable lemmy! the bad news: federation feels a little off to me? sometimes this is a federation queue thing that resolves itself, sometimes it’s an indication of a problem. things to test if you want to help out: - see if you can see your posts on other lemmy and mastodon instances - post here from other instances - see if you can load communities, threads, and comments in non-local communities (this is a big one) - see if you can load our communities from other instances and see up-to-date threads and comments - make sure your own profile settings are as they should be - if you aren’t getting email notifications and should be, let me know I’ll push all my changes and post a full changelog once we know 0.19.12’s running stable!

🚨 Breaking news: Wall Street folks panic at the first sign of turbulence, as usual. The sky is definitely falling, or maybe that's just their egos crashing down. Meanwhile, Varnish cache server just doesn't give a hoot. 🍿
https://www.independent.co.uk/business/wall-street-selloff-turns-ugly-as-us-recession-fears-grow-b2712420.html #WallStreetPanic #TurbulenceEgo #VarnishCache #ServerNews #TechHumor #HackerNews #ngated
Wall Street sell-off turns ‘ugly’ as US recession fears grow

On Wall Street, the S&P 500 had plunged 2.3% by the time European markets closed, and Dow Jones was down 1.2%.

The Independent
#server #servernews Hi folks! I've just updated the Mastodon server to 4.2.3 after it's been not updated for quite some time. So far seems to be running ok. If you notice issues, please let @admin and @joeterranova know
#ServerNews como sabrán, dada la economía argentina y que en este server somos poquitos, estoy pensando apagarlo porque es muy caro (estuve analizando alternativas más baratas, pero no se que tan bien andan para múltiples usuarios). Todavía no está la decisión tomada pero voy avisando por si quieren hacer backup 🙈
PCle and SAS Enterprise SSD Quarterly Shipments Decline, SATA Increases / ServerNews

Company Trendfocus, po message resource StorageNewsletter, published statistics on the global SSD market in the II quarter of 2023. The

GadgetPreeks
Worldwide quarterly HDD sales in capacitive terms collapsed by almost 20% / ServerNews

In the second quarter of 2023, according to data Digital Storage Technology Newsletter, worldwide HDD shipments in unit terms amounted

GadgetPreeks
#ServerNews disculpen el downtime 🫡 se le llenó el disco al server, pasé la escoba y ya programé a la robotina para la limpieza semanal