Anyone dealing with WAF challenges in their web scrapers?

https://docs.aws.amazon.com/waf/latest/APIReference/API_ChallengeAction.html

#WebArchives #digipres #WebArchiving

Fascinating interactive visualization of web history by Opera.

https://web-rewind.com/

Thx @matteusbeus for the link!

#InternetHistory #WebArchives #digipres #Enshittification #DH

New-to-me, from Library of Congress: Preserving U.S. Indigenous Government Websites: From Directory to Digital Archive. “As a 2025 Junior Fellow, Maggie Jones helped build the United States Indigenous Government Websites Web Archive with the guidance of her mentor, Giselle Aviles. In this interview, they describe how the collection developed from a list of over 500 tribes and what that process […]

RE: https://digipres.club/@mutanthumb/116132662038837684

I just ran through is a live demo earlier today, I’m happy to chat if anyone has questions. @dpc_chat #digitalpreservation #digipres #webarchives

Popular Science: The Internet Archive records its 1 trillionth website. “The Internet Archive—one of cyberspace’s most essential library projects—has achieved a feat that’s hard to even conceptualize. After nearly 30 years of painstaking work, the nonprofit has preserved its trillionth webpage.”

Ars Technica: Wikipedia blacklists Archive.today, starts removing 695,000 archive links. “In the course of discussing whether Archive.today should be deprecated because of the DDoS, Wikipedia editors discovered that the archive site altered snapshots of webpages to insert the name of the blogger who was targeted by the DDoS. The alterations were apparently fueled by a grudge against the blogger […]