Rob Ricci2d ago

Uh so a 10Gbps fiber link in my house failed...

So the WiFi AP connected to that switch just decided to go ahead and mesh with another AP, happily sending all the traffic over WiFi instead

Uh, wow? I didn't know it could do that? But cool?

Here's the thing: That switch has my NFS server on it. I've been serving music and movies from it. I've been running bittorrent for #sciop on it to back up literal terabytes of scientific data. It has 1/3 of my kubernetes cluster: I've been running the damn kubernetes control and data planes over wifi.

And it took me - I dunno? weeks? to notice.

JFC WiFi has come a long way.

Show threadjonny (good kind)May 28
so hopefully the picture is coming into focus of federated archive instances monitoring sets of pages, being able to distribute periodic and targeted snapshots of them as ongoing automatic scrape tasks across volunteer machines, autoseeding via torrent feeds, and then webtorrent-powered snapshot perusal. #sciop is just getting started baby.
jonny (good kind)May 25

here is a sneak preview of a very simple python package for creating and handling .torrent files.

https://torrent-models.readthedocs.io/en/latest/

https://github.com/p2p-ld/torrent-models

  • Full v2 and hybrid torrent support.
  • model-based validation, editing, and parsing with modern python type annotations and metadata.
  • Reasonable to use object when loaded with kind serdes handling (not just a wrapper around a bytestring dict)
  • Fast enough to use with a tracker/web service (a surprising amount of the existing packages have O(n2) spots for no reason, this is ~dozens-thousands of times faster than torf).
  • TODO: implement the rest of the BEPs, add methods for partial rehashing, more testing.

I was surprised this needed to be written since torrents are a relatively simple file format, but it did - none of the existing packages are suited for use as a library e.g. for tracker/client software and most can only do v1. I wrote this for sciop, where we want to be experimenting on the format, but also do stuff like dynamically modifying torrents to add trackers, webseeds, and other metadata. I'll do a full announcement after implementing the rest of the BEPs.

#Bittorrent #Python #Sciop #NewWork

torrent-models 0.0.2 documentation

Show threadDave RahardjaMay 25

@pixel As promised, here are detailed instructions on how to install the Deluge BitTorrent client and Autobrr RSS subscriber on a TrueNAS Scale device! These instructions are likely portable to other Docker-capable appliances as well.

With this I have been able to cache and seed 620 GB of SciOp data so far. Go do the same and help archive important scientific research data!

cc @SafeguardingResearch
cc @jonny

#resist #archive #sciOp #docker #truenas #torrents

https://www.humancode.us/2025/05/24/guide-to-deluge-autobrr-truenas.html

How to install Deluge and Autobrr on a TrueNAS Scale

This post guides you through the installation of Deluge and Autobrr on a TrueNAS Scale storage appliance.

humancode.us
jonny (good kind)May 24
we took an afternoon to add a quote randomizer to #sciop because we all have too many heroes to honor. to me, this project is in loving memory to all our friend Aaron Swartz, who would have been holding up the gray archives right alongside us, and who would have understood the difference between ensuring all people have access to information by putting them directly in contact with it vs. selling the promise of information access by renting a product to them.
Henrik SchönemannMay 19

Heya lovely people 👋
For #SciOp we (@SafeguardingResearch) are looking for dev contributions. There are a couple of bite-/morsel-sized tasks, e.g.:
- Make Publisher independent table https://codeberg.org/Safeguarding/sciop/issues/341
- Improve SearchableMixin to support full text search on joined items https://codeberg.org/Safeguarding/sciop/issues/182
- and more: https://codeberg.org/Safeguarding/sciop/projects/17078

The stack is #python (fastapi) + htmx, #sqlite (sqlmodel), "low-fi, standards-compliant html and almost no js"

Be a part of #SafeguardingResearch, join us!

Make `Publisher` independent table

Currently publisher is just a string, but it should be its own table. Need: - Title - slug (some of these have official abbreviations) - external identifier (e.g. an RRID) - parent/child relationships - Description - URL - Category? government, nonprofit, etc. - Permissions: `submit` c...

Codeberg.org
Show threadMoritz NegwerMay 18

@SafeguardingResearch

18) Repeat until your harddisk is full. Thank you for keeping a tiny sliver of humanity's collective knowledge from disappearing forever!

#sciop #RogueArchivism #defendresearch

Moritz NegwerMay 17
The outright wrecking of the scientific infrastructure in the US under the current administration chilled me to my bone. Kept me doomscrolling. But I finally found a way to do something positive, in a small way: I dedicated some storage space and a bit of my internet connection to a decentralized backup of deleted research data.
I am happy to report that @SafeguardingResearch 's torrent swarm now has ca 14 TB storage and a Gbit connection more.
#sciop #safeguardingresearch #academicchatter
Henrik SchönemannMay 16

In 3h I will be doing the first of semi-regular office hours / Q&A for @SafeguardingResearch
https://safeguar.de
https://sciop.net

Feel free to drop in!

More info:
https://fedihum.org/@SafeguardingResearch/114507714151685422
#SafeguardingResearch #SciOp

Safeguarding Research & Culture

"As researchers we often say 'we need the data'. Today, the data needs us." — Kathy Reid

Safeguarding Research & Culture
Henrik SchönemannMay 14

Bei #SciOp gibt es das Verfassungsschutzgutachten zur Einstufung der AfD als gesichert rechtsextremistisch jetzt auch: https://sciop.net/datasets/bfv-report-afd

Torrent über Internet Archive, inklusive Linksammlung

Update: Neuer torrent; infohash ist gleich, aber mehr tracker hinzugefügt
https://sciop.net/docs/intro/bittorrent/#trackers

#AfD #AfDGutachten

Verfassungsschutz: Gutachten zur Einstufung der AfD als gesichert rechtsextremistisch (leak) - Dataset - SciOp

Preserving Public Information