@Thorsted @chronodm @archivist_Liz
The real-world tests @beet_keeper, my friend Tom and I run on different FS and tools, and publishing our findings, hopefully helps to put more attention on handling and preserving #xattrs:
It's great fun! 🥳
@Thorsted @chronodm @archivist_Liz
...which is great! Thx @beet_keeper !
I've also contacted the following projects:
Samba, OpenMediaVault (OMV), rsync, engrampa, GNU find and others, to put #xattrs as "blip" on their radar.
OMV now has xattrs enabled in Samba by default 😁
It really feels like supporting long filenames "back then" 😉
https://cloud.arkthis.com/index.php/s/AHAlodeck2026?dir=/videos
A 50 minute show-and-tell, about #AHAlodeck, and how #xattrs on #ZFS can be used as #DataCentric catalog/environment.
Enjoy!
Perfect for #longterm preservation #dltp - and any other digital data collections.
#AHAlodeck R&D news:
- Testdataset: 386.5 GB
- 120.000 filesystem objects (files and folders)
- 7616839 key/value informations gathered/extracted as #xattrs.
Result: A 55 MB .tar.bz2 #holotar.
Fully search-and-filter-able by any of the 7 Mio xattrs.
Extraction step required only once (6h)
Afterwards:
Indexing done in 60 SECONDS! 🤩 🥇
This is so beautiful!
Screenshot of #mercs view of filesystem attributes of an #mp3 file ingested with Thomas' amazing 'holodexer' tool:
It simply adds fs-stats, exiftool and mediainfo on ZFS as #xattrs.
And a ❤️&⭐️ #CFID #CollisionFriendlyID.
By default and automatically.
Any existing data turns into a #DataGarden soil.
`getfattr -d -m - 0bytefile.mp3`
Download #wikidata dump for testing #ahalodeck and #xattrs on #zfs long-term storage... 😎
Found this while doing so:
https://www.wikidata.org/wiki/Wikidata:Lists/lexemes/en
It's a statistical breakdown of the #English #language. #Interesting.
I've made an interesting discovery:
2 years ago, I created a tar.bz2: containing a files-in-folder: 0-Byte filesize, but ID3 music metadata fully available - stored in the filesystem attributes (#xattrs)
Now I've realized that I can use this #tar not only to browse media collections (#DAM) in a highly portable and accessible format, but also that I can /write/ attributes (and other filesystem/metadata) changes to this "#holotar".
Using this as UI to interact on a lightweight copy of any data.
#AHAlodeck: My best friend wrote a mini-basic fulltext indexer for #xattrs in the shell.
Took ~1.5 seconds (!) to index ~14.000 files with "de-embedded" music tags.
🥳 🎉
I love xattrs.
Imagine doing this with embedded metadata tags? 😉
Archivierung und Kompression mit tar: Grundlagen, Optionen und Beispiele
tar (Tape Archiver) ist das Standard-Archivierungswerkzeug unter Linux, das mehrere Dateien und Ordner zu einem einzigen Archiv bündelt. Im Gegensatz zu gzip, bzip2 und xz komprimiert tar nicht selbst, sondern arbeitet mit Kompressionstools zusammen (z, j, J). Es erhält vollständige Metadaten inklusive Berechtigungen und SELinux-Kontexte. Wichtige Optionen von tar -c (create) : Erstellt ein neues Archiv. -f (file name). : Gibt den Dateinamen des Archivs an. # Einen Ordner […]https://andreas-moor.de/archivierung-und-kompression-mit-tar-grundlagen-optionen-und-beispiele/
I've received yet another request about "metadata in WAV"
But that file-format has no proper metadata support, and everything feels like a hack...
If #xattrs (Extended Attributes) would finally be as well-supported as Unicode-in-Filenames, it'd be quantum leap for annotation needs!
https://github.com/ArkThis/AHAlodeck/blob/main/doc/xattr_faq.md
Peter B.
Andreas Moor