Sami Lehtinen4d ago

I can’t believe that nobody has thought about copying files earlier. Do I really need to write my own program to sync folders efficiently? A good design would roughly double the transfer speed / cut time in half.

Why is there still no sane Linux sync tool for file systems, that does: stat-based compare, whole-file replace, preallocation, one file at a time, and a bounded read/write queue for concurrent streaming? Everything is either rsync-style overcomplicated, cloud-ish, inefficient or brittle.

#linux #sync #filecopy #fast #efficient

Show threadJohn4d ago

@sl I use syncthing. I'm not a big user (neither large shares nor large turnover) but it's been solid.

And still rsync for one-off backups etc ;-)

Show threadSami Lehtinen4d ago
@buckfiftyseven I use rsync exactly for backups, but it’s slow. Based on my discussion, I asked AI to draft me a specifications for the software, if I ask it later to write and test it. I’ll drop the spec in next message, because I’ll delete it later.
Show threadSami Lehtinen
fastsync - Now it works, I wrote a program to get the syncing done efficiently and it’s slightly over 100% faster than rsync. - What a nice result. I thought that there’s seriously something wrong with the rsync… #rsync #copy #files #linux
Jun 7 at 5:20pmWeb