I archived the Lawfare Media January 6 Archive with browsertrix-crawler, and tried my first #sciop upload for the WACZ:
https://sciop.net/datasets/lawfare-jan-6
I wonder if it's visible outside of my local network?
I archived the Lawfare Media January 6 Archive with browsertrix-crawler, and tried my first #sciop upload for the WACZ:
https://sciop.net/datasets/lawfare-jan-6
I wonder if it's visible outside of my local network?
Anfang 2025 sah sich die Scientific Community in den USA einer bisher in diesem Umfang nie dagewesenen politisch motivierten DatensĂ€uberung durch die dort neu gewĂ€hlte Regierung ausgesetzt. In einem Teil des alternativen sozialen Netzwerks Fediverse organisierte sich zu dieser Zeit eine Gruppe engagierter Freiwilliger, um letztendlich ein Guerillakollektiv zur Datenrettung zu bilden, das heute unter den Namen Safeguarding Research & Culture (SRC) bekannt ist. Aus dem SRC-Kollektiv heraus entstand wenig spĂ€ter auch die Open-Source-Software und Plattform SciOp. Diese ermöglicht mittels einer Integration von Datenkatalog und BitTorrent-Tracker eine dezentral verteilte und koordinierte Datenhaltung, an der jede Person mit der Bereitstellung von eigenem Speicherplatz und Bandbreite teilnehmen kann, um eine bessere VerfĂŒgbarkeit und zensurresistente Bereitstellung der geretteten Daten zu gewĂ€hrleisten. Dieser Beitrag zeichnet die Entstehungsgeschichte des Projekts nach und stellt dessen Besonderheiten im Vergleich zu konventionellen AnsĂ€tzen und Softwarelösungen im Bibliotheksbereich heraus. Es kann aufgezeigt werden, dass im begrenzten Umfang bekannte bibliothekarische Praktiken adaptiert wurden. Im Gegensatz zu traditionellen Bibliotheken bestehen jedoch neben dem besonderen technologischen Fundament des Projekts auch deutliche Unterschiede hinsichtlich dem Sammelschwerpunkt, der Organisationspraxis und den Partizipationsmöglichkeiten.
Anfang 2025 sah sich die Scientific Community in den USA einer bisher in diesem Umfang nie dagewesenen politisch motivierten DatensĂ€uberung durch die dort neu gewĂ€hlte Regierung ausgesetzt. In einem Teil des alternativen sozialen Netzwerks Fediverse organisierte sich zu dieser Zeit eine Gruppe engagierter Freiwilliger, um letztendlich ein Guerillakollektiv zur Datenrettung zu bilden, das heute unter den Namen Safeguarding Research & Culture (SRC) bekannt ist. Aus dem SRC-Kollektiv heraus entstand wenig spĂ€ter auch die Open-Source-Software und Plattform SciOp. Diese ermöglicht mittels einer Integration von Datenkatalog und BitTorrent-Tracker eine dezentral verteilte und koordinierte Datenhaltung, an der jede Person mit der Bereitstellung von eigenem Speicherplatz und Bandbreite teilnehmen kann, um eine bessere VerfĂŒgbarkeit und zensurresistente Bereitstellung der geretteten Daten zu gewĂ€hrleisten. Dieser Beitrag zeichnet die Entstehungsgeschichte des Projekts nach und stellt dessen Besonderheiten im Vergleich zu konventionellen AnsĂ€tzen und Softwarelösungen im Bibliotheksbereich heraus. Es kann aufgezeigt werden, dass im begrenzten Umfang bekannte bibliothekarische Praktiken adaptiert wurden. Im Gegensatz zu traditionellen Bibliotheken bestehen jedoch neben dem besonderen technologischen Fundament des Projekts auch deutliche Unterschiede hinsichtlich dem Sammelschwerpunkt, der Organisationspraxis und den Partizipationsmöglichkeiten.
http://librarypunk.gay/e/160-sciopnet-feat-jonny-and-jez-part-1/
>And this is exactly why Linux distributions have been distributing ISOs using torrents for years. Aside from the sort of piracy thing, that's the other thing that BitTorrent gets used a lot for, and it means that the small organizations throwing up their own Linux distro can distribute it without it completely crashing their tiny servers.
You're not wrong :P Pic related. It annoys me that #tails @tails recently moved away from having torrents as a form of downloading.
>Yeah, it makes me, think about, and something I've thought about before but haven't really explored is you know how when you go on Archive.org and there's a file, and one of your options is just to download a torrent. Why don't we do that for institutional repositories and data repositories?
That's one of my favourite parts of the Internet Archive :D
>Because those are starting to get big. I mean, I know one of the reasons is because, like, we use proprietary software for our institutional repository and Clarabate and Elsevier don't want to support that.
Elsevier, the bane of my academic existence.
-----
Also, vis-a-vis webseeds... what's stopping a Tor onion service from being the HTTP(S) endpoint? Those are pretty damn hard to bring down (from a legal standpoint). I'd assume the main limitation is that BitTorrent clients don't speak "onion service," but that's a fixable problem. Hell, what's stopping the trackers themselves from being onion services?
RE: https://neuromatch.social/@jonny/116218229348059739
impossible to quote myself because i am always speaking in like a 10-layer run-on, but, still thinking about private/public social systems that support resilient digital social systems, around 33:45....
instead of it being one #sciop and that's a unitary thing, we want to do the same thing here where we have a number of these different trackers that can be online and talk to each other and share metadata back and forth ...
the more important role of a tracker is a site of social coordination, a site of giving organization and structure to a bundle of torrents. in particular giving a focus - in the same way that what cd focused labor towards archiving music, having sciop focusing labor as a place to put the public information torrents is the main thing that it actually does. So building those kind of social systems into the tracker, and the next steps are making those social systems extend across multiple trackers ...
A lot of the peer to peer space, especially post crypto boom can lean very libertarian in terms of its design and its goals. That its goal is to make the one big public archive of everything, and that doesn't exactly fit in this context and it's just a very particular arrangement of power. ... If you build your system around assuming that everything should be public and should always be immediately available, then you don't have the means of making these kinds of gray-area private negotiations and discussions that might need to happen for data that's a little more sensitive.
So we need a federation and sharing model that can scale from private, literally peer-to-peer as in "i want to know exactly who is involved in this swarm of peers" up to the global public index. So that's the next step as far as what we're working on this year.
We were on librarypunk again to talk about #sciop. True to form I talk too much and they had to split it into two parts... Again...
http://librarypunk.gay/e/160-sciopnet-feat-jonny-and-jez-part-1/
We spent a bit too much time talking about bittorrent and not enough time talking about the underlying fascism of it all, but hopefully the goal of a federated tracker for connected communities to self-archive comes thru
Weâre talking with Jonny and Jez about SciOp, a torrent-focused data preservation project that encourages academics to help with the act of making data available. Itâs distributed, itâs robust, and SciOp is working on making it easy to do. [email protected] Contact Jonny: Fedi: https://elektrine.com/remote/[email protected] Bsky: https://bsky.app/profile/jo.nny.rip Media mentioned https://sciop.net/ https://forum.safeguar.de/about https://blog.sciop.net/2025-08-29/webseeds https://punctumbooks.com/titles/warez-the-infrastructure-and-aesthetics-of-piracy/ Safeguarding/sciop: collecting at-risk data in torrent rss feeds - Codeberg.org - https://codeberg.org/safeguarding/sciop- the scraping code, such as it is: https://codeberg.org/Safeguarding/sciop-scraping - sciop the blog, such as it is: https://blog.sciop.net/ https://programminghistorian.org/ https://book.the-turing-way.org/ last episodes on federation: https://www.librarypunk.gay/e/101-mastodon-bluesky-and-bullshit-part-1-feat-jonny-saunders/ https://www.librarypunk.gay/e/102-mastodon-bluesky-and-bullshit-part-2-feat-jonny/ Tools mentioned webrecorder, browser trix https://webrecorder.net/ https://webrecorder.net/browsertrix/ academictorrents - academic data tracker https://academictorrents.com/ aggregor mauve https://agregore.mauve.moe/ DRP - lumos https://www.icpsr.umich.edu/sites/datalumos/home https://en.wikipedia.org/wiki/Distributed_hash_table https://torrentfreak.com/controversy-as-rookie-admin-aspires-to-bittorrent-domination-080730/ ddos secrets https://ddosecrets.org/ Archive Team Warrior https://tracker.archiveteam.org/ How to contribute to sciop https://sciop.net/docs/quickstart/ Create account. Create a torrent. [find how to link for how to create a torrent] Upload. Get permission so they are visible to others. Seed. Transcripts: https://podscripts.co/podcasts/librarypunk Join the Discord: https://discord.gg/qWPTurTnkT