Infosec Lurker | Technical Debt Collector
It's not for fun, or any sense of community.
It's just trying to dull the pain.
Pronouns | he/him |
Infosec Lurker | Technical Debt Collector
It's not for fun, or any sense of community.
It's just trying to dull the pain.
Pronouns | he/him |
@hrbrmstr
AC tech: ope, looks like it's a board, we can either order one and it'll take 8-12 weeks or you can buy a whole new system for $20k and have it today.
AC tech: No, I didn't bring any tools, why do you ask?
check this out if you want to help preserve the archive of "most local newspapers through most of US history" that had its funding pulled, even if you only have a couple dozen gigabytes to spare, you can
a) make an account on https://sciop.net/ ,
b) run a qbittorrent instance, go to preferences>web ui and click enable,
and just do this
python -m pip install sciop-scraping
sciop-cli login
sciop-cli client add
sciop-scrape chronicling-america --next
and that's all.
if you have spare storage, you can sort by seeders, ascending, and start from there. or subscribe to the rss feed and auto-download it.
this is an archive funded by the library of congress (threatened) and the national endowment for the humanities (actively being eliminated). the alternative is that an enormous amount of US history that doesn't percolate into history books is owned and operated by lexisnexis and other for-profit data brokers.
this is the first run of some tooling to lower the bar for participatory scraping - at the moment, the archive is still online, and the scraper will automatically embed a webseed URL in the created torrent. so even if you don't have space to seed, you can scrape the data, upload the torrent, and make it possible for waiting peers to become mirrors