Hey fellow nerds.
How do you handle large-ish volume backups between Linux hosts? About 1TB of data. Source has 100Mbps upload. Receiving end is Gbit.
Incrementals will be essential, since full backup is nearly a day's worth of upload.
FOSS suggestions only at this stage. It's currently performing backups put of my control with Veeam and I'm a bit nervous about the whole situation being out of my hands.
@lakeswimmer What would be "better", in your view? It depends a lot on what you want to back up, how often, and where from/to. If you are backing up disk images, you really should be using something snaphotty (as the ZFS enthusiast suggested), if you are backing up files, especially if Linux to Linux, it's hard to go past rsync - partials, hardlinking, lots of controls, exclusion lists, inclusion lists, compression...
If you need some kind of scaffolding to look at, arrange, select, restore from, document or index your backups, then rsync may be too low-level.
@lakeswimmer I use #rsnapshot. Been using it for years and it works great. I'm also one of the project maintainers so am biased.
In a brand new installation where everything used #ZFS (and really, everything *should* use ZFS - if it's not properly supported in your OS the OS is faulty and you should use a different one) then these days I'd use zfs send/recv, wrapped in #sanoid / #syncoid - https://github.com/jimsalterjrs/sanoid
@lakeswimmer I have (some time ago) read good things about Borg backup. Have not yet tried it myself though....
Lakeswimmer
kauer
David Cantrell 🏏
Darren Wilkinson
Aaron Brick — אהרן בריק
niq