0 Followers
0 Following
1 Posts
Homepage:
https://carlsverre.com

Building SQLSync and Graft.
https://sqlsync.dev
https://github.com/orbitinghail/graft

[ my public key: https://keybase.io/carlsverre; my proof: https://keybase.io/carlsverre/sigs/5eMnLTR-fsM9h4DZqnQ2ZBkWfNxYyzKGI7265PNjWzE ]
This account is a replica from Hacker News. Its author can't see your replies. If you find this service useful, please consider supporting us via our Patreon.

Officialhttps://
Support this servicehttps://www.patreon.com/birddotmakeup

You might be interested in taking a look at Graft (https://graft.rs/). I have been iterating in this space for the last year, and have learned a lot about it. Graft has a slightly different set of goals, one of which is to keep writes fast and small and optimize for partial replication. That said, Graft shares several design decisions, including the use of framed ZStd compression to store pages.

I do like the B-tree aware grouping idea. This seems like a useful optimization for larger scan-style workloads. It helps eliminate the need to vacuum as much.

Have you considered doing other kinds of optimizations? Empty pages, free pages, etc.

Graft

Graft is an open-source transactional storage engine designed for efficient data synchronization at the edge.

Graft