Just migrated this #Mastodon server's #DockerCompose setup from #DockerDesktop to #Colima. (Also migrated #CalibreWeb.) On an 8 GB RAM M2 #Mac mini with 8 cores, you need all the memory and CPU savings you can get.

https://PhoenixTrap.com #blog post to come, because I ran into #database file permission problems with the #Docker Hardened Image for #PostgeSQL 17 and had to switch to the upstream official image.

#DHI #Postgres #Calibre #macOS #DevOps #PlatformEngineering #containers

The Phoenix Trap: Code, music, philosophy, etc.

Personal blog of Mark Gardner. I help Perl devel­op­ers build mod­ern, disciplined appli­ca­tions by writing easy-​to-​main­tain code with con­fi­dence.

The Phoenix Trap
Building a weather data warehouse part I: Loading a trillion rows of weather data into TimescaleDB
https://aliramadhan.me/2024/03/31/trillion-rows.html
#postgesql
Building a weather data warehouse part I: Loading a trillion rows of weather data into TimescaleDB

pruning/vacuuming with large *sql* databases is annoying with limited disk space.

#sql #postgesql #sqlite

Mutig das Update auf #mastodon 4.3.0 vollzogen. Ich Dussel hab erst da gemerkt, das aktuell zwei Versionen vom #postgesql auf dem Server parallel laufen. Nach manuellem portieren der Datenbank von 11 nach 14 geht es dann nun auch wieder. 🤓

@Gankra depends...

xz and lzma2 are pretty good when it comes to compression ratio, and with modern hardware they are sufficiently fast.

  • But there's a reason a lot of stuff, like online games, use bz2 instead, since that allows speeds in excess of 600 Mbit/s even on low-end systems with minimal load, and in my experience allows compression of backups like #PostgeSQL's cluster_backup at basically I/O speeds with <10% CPU load even at very old servers...

So there's that...

AFAICT xz is basically at the limit of lossless data compression - anything more efficient I know are extremely lossy narrowband codecs like #Codec2 @450 bit/s TWELP @ 300 bit/s and #STANAG4591 aka. MELPe that sound like one has their ears filled with water and the person talking has a gag ball in their mouth and screams.

XZ Utils - Wikipedia

@briankung nope. It worked and then stopped (went through that multiple times).
So I've switched to #Postgesql and it doesn't seem to have the same problem.
Interesting that both Sqlx for #RustLang and #GoLang have similar problems with #sqlite3
Huch? Was ist denn nun? 😮
Meine Probleme mit #Pleroma und/oder #PostgeSQL und den nicht ladenden Profilseiten sind jetzt einfach weg? Einfach so? Ohne, dass ich ernsthaft was gefixt hätte? 🤪

Das ist natürlich schön, weil ich langsam echt ratlos war und schon überlegte, die Domain für's Fediverse aufzugeben (also eine neue, frische Instanz auf anderer Domain hochzuziehen), aber gewusst hätte ich schon gerne, was das war und warum es jetzt wieder geht.. 🤔
Het was vroeg vandaag. Maar het is het nu al waard.
Mastodon.nl op een nieuwe versie van de #postgesql database server.
Een artikel in Trouw met foto’s van het #ProcoliX datacenter in Amsterdam.
En vanmiddag/vanavond vieren dat we 22 jaar bestaan! #feest 🥳
@moonman If you're on #Digital_Ocean, my experience is that something about their droplets' default configuration hindered both #MySQL / #MariaDB and #PostgeSQL performance. A smaller resource #VPS on #Linode runs them much better than DO.
.
I may try one on #Vultr soon.
Shitposter Club