Andrew NesbittInstead of using git as a database, what if you used database as a git?
luna the doggie 
@andrewnez actually I would argue storage efficiency is important for making it accessible to self-host.
If you don't have a bunch of disposable income to put towards a homelab, storage really isn't very cheap. Especially now that prices of everything have doubled or tripled due to AI datacenter demand.
Renting a VPS with more than 20-50GB of storage gets expensive very fast. Too expensive for many people.
Using an old PC for hosting can sometimes be an option but that will have reliability issues, and you probably won't have more than like 1TB of space available then anyway. Also dependent on your ISP giving you public IPs.
If you don't have a bunch of disposable income to put towards a homelab, storage really isn't very cheap. Especially now that prices of everything have doubled or tripled due to AI datacenter demand.
Renting a VPS with more than 20-50GB of storage gets expensive very fast. Too expensive for many people.
Using an old PC for hosting can sometimes be an option but that will have reliability issues, and you probably won't have more than like 1TB of space available then anyway. Also dependent on your ISP giving you public IPs.
World Basement Classic@lunareclipse @andrewnez I'd be interested to know if anybody's explored how effective it is to run Postgres on a deduplicating filesystem like ZFS or brtfs.
Hopefully, it might be that this is a non-issue in practice without having to build deduplication or delta compression into Postgres directly.
walnut 🌱@diffrentcolours @lunareclipse @andrewnez
I don't know much about this, but it seems like the tradeoffs/gains would need to be measured on a case by case basis still
despairlabs.com/blog/posts/2024-10-27-openzfs-dedup-is-good-dont-use-it/
I don't know much about this, but it seems like the tradeoffs/gains would need to be measured on a case by case basis still
despairlabs.com/blog/posts/2024-10-27-openzfs-dedup-is-good-dont-use-it/
OpenZFS deduplication is good now and you shouldn't use it
OpenZFS 2.3.0 will be released any day now, and it includes the new “Fast Dedup” feature. My team at Klara spent many months in 2023 and 2024 working on it, and we reckon it’s pretty good, a huge step up from the old dedup as well as being a solid base for further improvements. I’ve been watching various forums and mailing lists since it was announced, and the thing I kept seeing was people saying something like “it has the same problems as the old dedup; needs too much memory, nukes your performance”. While that was true (ish), and is now significantly less true, the real problem is that this just repeating the same old non-information that they probably heard from someone else repeating it.