I love that Project Gutenberg has a page on how to use rsync to copy their entire collection.

https://www.gutenberg.org/help/mirroring.html#Using_Rsync

I also love that they tell you at the end of that how to put it in a cron job so you just have an always up to date copy.

Project Gutenberg

Project Gutenberg is a library of free eBooks.

Project Gutenberg
@mhoye also they recommend you have "T1 (~1.5Mb symmetric) or faster permanent network connection". That's, what, half a shitty DSL connection?
@nelson I don't think that you can buy a home internet connection that slow anymore.

@mhoye @nelson However you may buy a home internet connection with a less-than-stellar upload speed (compared to your download speed), which, as PG says, would not be good for mirroring.

(added fun fact: saturating, or even getting close to, your upload speed will quite certainly cause your download speed to collapse.)

@mhoye I ran across a comprehensive video game ROM site a couple months ago that suggested using rsync to copy stuff en masse and keep it up to date. I was thoroughly impressed.
@mhoye that's a ridiculous amount of ebooks!
@mhoye gonna have to try this out
@mhoye Just finished reading a chapter of The Wizard of Oz to my kid. I downloaded it from Gutenberg.
@mhoye Fantastic! (Reminds me that I met Michael Hart in like the early 90s at the University of Illinois, a little group of like two or three undergrads and him chatted for like an hour, was a weird fun time.)

@mhoye do they specify how much disk space is needed for the full collection?

@timotheegoguely

@mhoye and cron! Nice. Could use systemd timer example too.