Deniable1477

Cloud Backup

https://lemmy.world/post/1635510

Cloud Backup - Lemmy.world

I finally got the dreaded over storage warning from google today. What is everyone moving to these days? People were moving to dropbox advance but i heard its not really unlimited anymore. I have 30TB of data that can’t be reproduced (family videos and photos). Any recommendations? I prefer not to spend $100+ a month on backups but if i have to do it then i’ll do it.

Jul 17, 2023 at 5:44pmWeb
Show threadChojinDSLJul 17, 2023
Build a NAS. If you’ve already got one, build a second one as backup. It’s cheaper in the long run than most cloud storage solutions. Especially when you factor in the time it would take for a complete restore.
Show threadkhannieJul 17, 2023
The main issue with a NAS for this use case is the “what if my house burns down” scenario. Zero/ low effort off site backups are really important for treasured memories.
Show threadtonynJul 17, 2023
I’m currently working on this problem. My plan is to use a Phoenix DataCare 2001 media firesafe to rotate a copy of my full backup. See my post for the discussion.
Help me with a rotating firesafe data backup - Lemmy

I have between 20-30 TB of data I want to keep a copy of in a firesafe. I do not want to use an online storage solution, I want to maintain my personal data at my home. My current plan is to get (2) Mediasonic HFR2-SU3S2 PRORAID enclosures and (8) WD Red Pro NAS 16TB drives to fill them. The first would contain a full backup and be placed in the safe. The second would be attached to my machine and receive nightly backups. Periodically, I would rotate the enclosures, taking the one from the safe and swap it with the one connected to my machine. Are there any problems with my plan that I am not thinking of? Are there better solutions? Is anyone else keeping a rotating data backup in a safe? How is it working out for you?

Show threadTenpoundheroJul 17, 2023
Also I believe that backblaze can do NAS backups now relatively affordable.
Show threadCatsrulesJul 17, 2023
Last I looked it was .005 GB/Month. That adds up quickly when you have 30TB.
Show threadTenpoundheroJul 17, 2023
That’s a very fair point, they also offer the setup where you can rent a hard drive and ship the initial “upload” (with 30TB that can still be an issue).
Show threadCatsrulesJul 17, 2023
When I looked last time I didn’t see anything about different pricing on NAS backup. But I also didn’t look very hard.
Show threadTenpoundheroJul 17, 2023

Last I looked it was .005 GB/Month. That adds up quickly when you have 30TB.

Nope. so just looked and you were bang on. So for OP, $150+ including some bulk download if needed.

Show threadCatsrulesJul 17, 2023

I think the days of unlimited backups are coming to a close. I don’t know of any truly unlimited storage anymore.

At that size do you have and friends or family you could just use as an off site backup? It would be a high upfront cost for buying the drives and hardware but should be much cheaper overall. If that is something your looking for.

Or even a safety deposit box for an offline/offsite backup.

Show threadJollyRobertsJul 17, 2023

@Catsrules

Agreed with this one really. "3 copies of your data, in 2 physical locations, equals 1 backup" has been my thing for a long time.

I used to just keep my third copy one a drive in my desk at the office, but I've been full remote for years now.

Thanks for the reminder, I need to see if I can convince my folks to host a NAS in their hobby room or something.

@Deniable1477

Show threadWillJul 17, 2023
@[email protected] @[email protected] @[email protected]

Thats what I ended up doing. I've been a photographer for years and have started digitizing old family videos and photos. 8tb or so of data is way too expensive to cover.

So, nightly backups at home to storage and then replication to a nas at the rents via vpn.
Show threadDeniable1477Jul 18, 2023
I currently have a NAS at home and another one at my parent’s house a few towns over. I don’t know anyone out of state that’s willing to host a NAS for me. I prefer to have my data in the cloud since me and my parents don’t live that far from me and the data is irreplaceable.
Show threadCatsrulesJul 18, 2023
Ahh that makes sense. In that case I think AWS Glacier might be your cheapest option.
Show threadBoofStrokeJul 17, 2023

Local NAS with one share for Borg and proxmox image backups. That is then sync’d to S3 glacier. Borg is used for compressed, deduped archives of all important data. I do 3 daily, 4 weekly, 3 monthly.

Borg to rsync.net works too. Or just use rsync.net directly and they will snapshot for you. Borg accounts are cheaper though.

Show threadlioriJul 17, 2023
There’s Jottacloud with unlimited storage for 10 EUR/month, but they gradually slow down after first 5 TB. 30 TB might be a bit too much. There’s Hetzner with their dedicated 4×10TB machines for ~52 EUR, you could do RAID5 and have somewhat redundant 30 TB, at the cost of self-managing a dedicated machine. There are several providers doing regular S3 (which you can take advantage of with tools like rclone) with decent redundancy for 4-5 USD/TB + egress. For high-value data you should be probably spending more than 100 USD/month for 30TB in the cloud, or invest in actual hardware. Do you need hot access to this dataset, or is a cold storage archive enough?
Show threadDeniable1477Jul 18, 2023
Cold storage is enough. Most of the data are pictures and videos that i don’t access regularly. I was looking at Hetzner but it looks like most of the servers are in the EU. I’m based out of the US so i’m guessing file transfer would be slow. I also don’t have experience with Hetzner but if they are reputable then i don’t have an issue with going down that route.
Show threadlioriJul 18, 2023
Yep, it’s EU. File transfer shouldn’t be bad if your files are large, though it’s best if you tested it first—it might depend on your ISP’s peering. Whether it’s reputable for your purpose, you probably have to do your own research. Also, remember that the offer I mentioned would only be equivalent in durability to a single-box RAID5 for your purposes, so not exactly equivalent to Google’s.
Show threadTheGreenGolemJul 17, 2023
I use AWS S3 Glacier Deep Archive. 30 TB would cost you about $27 per month.
Show threadCatsrulesJul 17, 2023
How much is it to retrieve the data if needed?
Show threadMigratingtoLemmyJul 17, 2023
Build A NAS, and AWS Glacier for the very important data. I think AWS is less expensive than BackBlaze
Show threadCanOpenerJul 18, 2023
AWS Glacier will be cheaper until you need to restore the data. On AWS, you’ll pay $0.09/GB for bandwidth + Glacier retrieval fees. Over time, AWS might be cheaper but you’ll be looking at a $3000+ bill to restore 30 TB.
Show threadMigratingtoLemmyJul 18, 2023
That’s a good point. Which provider should I go for, for about 15TB?
Show threadCanOpenerJul 18, 2023
The cheapest option I’ve found is Hetzner storage boxes, they don’t even charge for bandwidth. Backblaze and Wasabi are good options too, but Backblaze charges for outbound bandwidth and Wasabi is increasing their prices.
Storage Box: secure & cheap online backup solution

Secure storage online backup service: ✓ cheap data storage ✓ GDPR-compliant hosted in germany and finland ✓ 100 % green electricity

Show threadMigratingtoLemmyJul 18, 2023
That’s a fantastic find. If someone could limit the ultra important media/assets to 1TB, this is fairly affordable. And no transfer fees too!
Show threadhoodlemJul 17, 2023
I use Backblaze B2 and M-Discs for the really important stuff. For replaceable media, I use HDDs, one local and one remote.
Show threadChojinDSLJul 18, 2023
What you also might consider is re-encoding your stuff to use less space. Photos can be stored as lower quality jpgs and home movies can be reencoded as hevc. The latter can even be done automatically using something like tdarr.
Show threadg_damianJul 26, 2023
Scaleway Glacier costs ~€0.002/GB/month, so ~€60 / 30TB
Glacier Cold storage | Scaleway

Ideal for deep archived data.

Scaleway
Show threadg_damianJul 27, 2023
idrive e2 costs $50 / 30TB / month and it’s hot storage
IDrive® e2 plans and pricing for cloud storage

IDrive® e2 offers secure cloud object storage and seamless access to your data at affordable pricing

Show threadbierJul 26, 2023

if you backup locally so not over a network share you could use Backblazes Personal Backup ( hub.docker.com/r/…/backblaze-personal-wine ) it’s like 8$ for unlimited backup

but they have some kind of tracking for blocking cifs/smb shares but you can circumvent that using dolany my current setup as my data is mainly just a Hetzner 20tb storage box I have a second windows VPS that mounts that CIFS storage using dokany und Just run backblaze Personal backup there was a real hassle to set up an the backup takes for ever but yeah it works

Docker