What are your offsite backup solutions
I’ve been backing up to a dedicated hard disk within the same server for all my backups in case my disks fail. And as I run more and more services, the concern of disks failures grow bigger. I’m looking for a cheapish off-site backup solution and I’m just curious what everyone does for their 3-2-1 backup solutions.
I have a borg server in the office that takes backups of all my servers. Each server stores their applications backup that gets pulled into the repo. On top of that, the borg server pushes the backup to rsync.net.
All of this is monitored by my Zabbix server
I use restic/borg (depending on servers) and push to a bunch of S3 buckets on Backblaze. This applies to my desktop, my NAS and in general my non-Kubernetes data.
For Kubernetes I wrote a small tool that...well does the same for PVCs. Packs up the data with restic (soon I hope to migrate to rustic, once the library gets polished) and pushes to Backblaze.
To give an idea of the pricing, for 730GB, with daily backups or more, I pay approximately $5 a month.
Restic is fantastic. It's just one binary, has support for various cloud services (including Backblaze which I use as well), snapshots which can be mounted with FUSE. It's really quite useful. Borg I believe is similar?
Either way, I feel like today there is no reason to use awkward rsync solutions when better tools are out that have proven themselves.
i use duplicati to back up configs and data for docker containers to 2 cloud services. my 8 TB server is almost maxed. i need funds to buy a backup for that and expand.
I know synology (and others probably) have an app where you can back up your data to your friends NAS and vice versa, but that's taking up their storage too and cost for HDD/SSD may be prohibitive
I don't understand, I don't know more than the prices they list which are pretty clear?
Just make sure you use the rsync flag made for stuff like R2, otherwise the API calls become expensive.
Came here to comment this "obscure" combination. That I use. Lol
Kopia is a solid bit of software. I run it on my VPS's, my homelab and my desktop/laptops. All to a single Backblaze repo.
I just switched to Kopia and B2 a few months back and it is working great so far. I backup my machines with Kopia to a local Unraid box on my network running Kopia server. Then the Kopia repo on the Unraid box is synced up to Backblaze B2 nightly.
I'm only backing up around 200 GB of data so the B2 storage is something like $1 a month.
Urbackup for workstations, and Proxmox Backup Server for my 2 Proxmox hosts.
Both configured with borg backups to rsync.net.
I haven't configured it yet, but I am planning on using rsync.net for my Synology as well (Which is mostly archive storage)
Restic to Wasabi.
I used to use Backblaze B2, until I did the maths on how much it would cost me to restore. B2 storage is cheap yes, but the egress is so fucking expensive. It would have cost me hundreds.
Wasabi storage is equally cheap, and restoring won't cost me an arm and a leg.
I use the following scripts for Restic: https://gitlab.com/finewolf-projects/restic-wrapper-scripts
wasabi is cheaper than B2 unless...
The 3 points above are how they can not charge egress for the majority of people.
Remember, this is for an offsite backup scenario.
wasabi is cheaper than B2 unless… you store less than 1TB
Yeah, absolutely. In my case, I backup way more than 1TB.
you pay for any data you upload for 90 days minimum
Which is absolutely acceptable in a offsite backup scenario. The data there is present for a long time, and if you use a solution like Restic which has deduplication capabilities, this is not an issue.
You can only download the same amount as you store in a month without incurring egress costs.
This is false. You can only download the same amount as you store in a month without violating the terms of service. That said, I've been using Wasabi in a professional manner for a number of years now, and as long as it isn't a regular occurrence, you can always contact support and give them a heads up that you do need to have more egress in a month.
This only occurs if you have to do a full restore TWICE in a month, which I had to once due to our team not noticing that the SAS controlled had failed and was responsible for corrupting data; not the drives. Support was quick, and it was no issue. Still didn't pay for that egress.
I've got a Tarsnap account backing up my especially important data every night, which is admittedly only a couple of gigabytes of scans of important documents, hard to replace files, etc. It's doing snapshot-style backup with a backup for every day in the last week, every week of the last month, every month of the last year, and the last three years. Paying less than a dollar a month for it, so it's working out.
That stuff also gets rsync'd each night onto my NAS, which has its own automated LVM snapshot system going on along the same lines, and I'm using syncthing to mirror it onto my other PCs as a final last-ditch backup (and in case I need it elsewhere). Finally, there's an external hard drive I keep manual backups on every once in a while.
Larger datasets that aren't really stuff I want to pay for on the cloud (14 TB worth) just get stored on the NAS and a drawer full of external hard drives. Not ideal, but it's just way too much data.
No. They're not that sensitive. And if I did, I'd lose the ability to search their contents through the Google Drive interface.
I also use SpiderOak, and they say they use end-to-end encryption. That's where I keep my tax returns and other finance stuff.
I have a 2 x 8TB in RAID1 NAS at a family members house and I also have an OVH dedicated server with 2 x 480GB in RAID1 and 2 x 8TB in RAID1. I use rclone for my backups and keep deleted files for 30 days on the NAS and 120 days on the OVH dedicated server. Both the NAS and server connect back to my home network using WireGuard.
The OVH dedicated server also runs numerous virtual machines that host websites as well as backups of my netbox and mediawiki instance I run at home(they sync nightly).
I don't worry about getting raided by the FBI at all since I don't live in the US lol
But apparently some people worry about it....but if those same people knew how to protect themselves while using the internet they wouldn't need to worry at all.
First they'd need a reason which they won't find.
Secondly in my 20+ working in IT and using the internet I've never once heard that statement about it be "generally advisable to avoid using friends and family for offsite storage". Needed a good laugh. Thanks.
I got it when they had a deal about a month ago so it's only $65.09/month (Canadian) on a 12 month commetment.
I feel it's just the right price given the specs. Xeon-E 2274G, 32GB RAM, 2 x 480GB SSD, 2 X 8TB HDD, and unmetered 500/500 connection.
I've currently got 6 VMs on it and the Load Average is 0.38, 0.36, 0.36 and the CPU stays under 20%. I have plans to add 3 or 4 more. The VMs are mostly for family members websites/blogs, super low traffic.
I'm using AWS S3. I've got a script on my RPI that runs daily and uses the AWS CLI to sync my photos etc to there, and stores it as Glacier storage.
It's about US$9 per month for 800GB of storage, at that time it was the cheapest and most convenient.
I use Borg + borgmatic (although I may be a little biased there...) and backup to BorgBase and rsync.net. When figuring out where your "cheapish" off-site backup solution should be, you need to take into account: How much data you want to store, how much you expect it to be deduplicated, how much you expect it to grow, and your needs for retrieval and egress. See some of the other comments here on some of the pros/cons of various providers.
Also, it should be said that Borg doesn't directly support non-SSH cloud storage providers, although you could always backup with Borg locally and then rclone that to a cloud provider. Restic does support non-SSH cloud storage directly, but then no borgmatic. So, 🤷.
To copy a comment from reddit:
maya329
celipon
Shortcake
Scrubbles
binwiederhier
netburnr
cwagner
Kata1yst
darmok
MeowdyPardner
privsecfoss
ZenArtist
FineWolf
D4NM3D
Gourd
ahto
LinuturkHTWingNut:
Backblaze Personal only works with Windows PC's and Mac, and drives that are physically connected to the computer. No VM's, no network drives/hardlinks/symlinks, etc. You have to use their software to backup too. As someone else noted, for recovery you can grab files in 500GB chunks as a zip, or 8TB drive mailed to you (free of charge up to 5 per year). Data needs to be retained on your local drives otherwise it will delete them from their servers after 30 days unless you upgrade to their 1 year retention plan.
I have a Windows PC that is on 24/7 for a number of things, and I just put a hard drive in there that I backup my most important NAS files to that, and it gets backed up to Backblaze Personal.
Backblaze Personal is cheap and I see the appeal, but you have to understand and live with those caveats for "unlimited" backup.
I use B2 with rclone and just backup "important" stuff on my NAS with cron jobs. I guess you could have rclone move the "important" stuff from NAS to a "burner" PC which uses Backblaze Personal.
I don't have enough data to warrant all that so I use B2 for now and I have around 50GB of data so the price is cheap