#FDUPES

Observation: an fdupes operation via LAN on MX-Linux (debian 12)
vs Ubuntu vsersion of WSL2 on Win10
where
MX-Linux on lan processed (that is a dry-run summary, and done) about 12k items in the amount of time the Ubuntu WSL has not yet finihsed presenting the summary.

wonders me why

is that all that MS .. ACL or whatever..

that's the thing behind your ankle. don't damage it.

Aktuelles Lieblings-Shell Tool: fdupes
https://github.com/adrianlopezroche/fdupes

Superschnelles Auffinden (optional: Entfernen) von Datei-Duplikaten auf der Platte. Sehr hilfreich, um den Google Takeout zu de-duplizieren, bevor es auf eine #NoBigTech Cloud geht.

#linux #fdupes

GitHub - adrianlopezroche/fdupes: FDUPES is a program for identifying or deleting duplicate files residing within specified directories.

FDUPES is a program for identifying or deleting duplicate files residing within specified directories. - adrianlopezroche/fdupes

GitHub
My personal photos were an absolute mess. I had a Google Takeout, an old iPhoto library, a number of CF cards and USB sticks with backups. Part of the mess was that there were overlaps between these piles of photos... I first started out with find/md5sum+shell but quickly switched to #fdupes (https://github.com/adrianlopezroche/fdupes). Very quick and the interactive delete mode is quite helpful.
GitHub - adrianlopezroche/fdupes: FDUPES is a program for identifying or deleting duplicate files residing within specified directories.

FDUPES is a program for identifying or deleting duplicate files residing within specified directories. - adrianlopezroche/fdupes

GitHub
There's still time to download your SysAdmin Day gift: 10 Terrific Tools for the Busy Admin. Get your free copy today! Special thanks to our partner #TuxCare https://mailchi.mp/admin-magazine.com/sysadmin-day-2024
#security #tools #sysadmin #network #SysAdminDay #utilities #neofetch #debvm #Tiger #fdupes #coreboot #Linux #OpenSource
500: We've Run Into An Issue | Mailchimp

#blog post about how I made a quick bash wrapper script around #fdupes that outputs to a text file so I could confirm what I was about to actually do before moving the duplicates to a temporary trash directory for manual deletion. After some... bad accidents with `rm -rf` 😅 I was being careful with my #filemanagement deeds https://peekread.info/tech/20230706-using-fdupes-to-cleanup-my-file-server/
Using fdupes to cleanup my file server

The overall problem: Like many of us, I am guilty of copying files haphazardly, promising myself that I'll organize them later. This careless behaviour has caused a significant problem over the years,

Peek Read Info

Aktuell läuft #jdupes um doppelte Dateien im #Backup durch Hardlinks zu ersetzen. Es soll bis 7x schneller als #rdfind oder #fdupes sein. #opensource

https://github.com/jbruchon/jdupes

GitHub - jbruchon/jdupes: A powerful duplicate file finder and an enhanced fork of 'fdupes'.

A powerful duplicate file finder and an enhanced fork of 'fdupes'. - GitHub - jbruchon/jdupes: A powerful duplicate file finder and an enhanced fork of 'fdupes'.

GitHub

Frage an die #Foto Leute die auch unter #linux unterwegs sind.

#Doppelte #Bilder/ #Fotos #finden: Wie macht Ihr das?

Was ich bisher als Werkzeuge habe:

#rdfind und #fdupes sowie #FSLint (+GUI).

Irgendwie nehmen die mir die Orga der Fotos/Dateien nicht gut ab. Für 100% identische wird es gehen.

Aber Modifikationen (Gleiches Motiv andere Skallierung) eben nicht (Um Originale zu finden!).

Gab mal ein Tool das Fotos vergleichen und Näherungen fand. FindsNichtMehr

Freue mich über Ideen :-)

DeaDSouL/dugu

Find, remove and avoid duplicates with dugu: The Duplicates Guru - DeaDSouL/dugu

@schlink It would a little bit silly, because there are so many out there already:

https://www.virkki.com/jyri/articles/index.php/duplicate-finder-performance-2018-edition/

https://github.com/topics/duplicate-files

But then again, at first glance none of them are written in Rust nor Go! =)

A fun exercise if nothing else, with a couple of real-world concerns coming together.

#dupd #jdupes #rdfind #fdupes #rmlint #duff #fslint

@brandon
Duplicate finder performance (2018 edition) | stdout

#fdupes is a duplicate file finder.

fdupes is a command line program for finding and deleting duplicate files. fdupes shows a list of duplicates to the user, which they can use to select files to delete. fdupes supports recursion as well as non-interactive use.

Website 🔗️: https://github.com/adrianlopezroche/fdupes

apt 📦️: fdupes

#free #opensource #foss #fossmendations #sysadmin

GitHub - adrianlopezroche/fdupes: FDUPES is a program for identifying or deleting duplicate files residing within specified directories.

FDUPES is a program for identifying or deleting duplicate files residing within specified directories. - adrianlopezroche/fdupes

GitHub