"…to be a fad, you must be liked. To be infrastructure, you must be required."
Stu Brand’s pace layer model applied to investment strategy.
https://longnow.org/p/70c7978a-6bbb-470c-8b99-6e6116648991/?member_status=free

#longnow @longnow

The 26,000-Year Astronomical Monument Hidden in Plain Sight

The western flank of the Hoover Dam holds a celestial map that marks the time of the dam’s creation based on the 25,772-year axial precession of the earth.

Long Now

The Long Now of the Web: Inside the Internet Archive’s Fight Against Forgetting – HackerNoon

New Story, 1,290 reads

The Long Now of the Web: Inside the Internet Archive’s Fight Against Forgetting

by Bruce Li, January 12th, 2026

A Comprehensive Engineering and Operational Analysis of the Internet Archive

Introduction: The Hum of History in the Fog

If you stand quietly in the nave of the former Christian Science church on Funston Avenue in San Francisco’s Richmond District, you can hear the sound of the internet breathing. It is not the chaotic screech of a dial-up modem or the ping of a notification, but a steady, industrial hum—a low-frequency thrum generated by hundreds of spinning hard drives and the high-velocity fans that cool them. This is the headquarters of the Internet Archive, a non-profit library that has taken on the Sisyphean task of recording the entire digital history of human civilization.

Internet Archive’s office in San Francisco

Here, amidst the repurposed neoclassical columns and wooden pews of a building constructed to worship a different kind of permanence, lies the physical manifestation of the “virtual” world. We tend to think of the internet as an ethereal cloud, a place without geography or mass. But in this building, the internet has weight. It has heat. It requires electricity, maintenance, and a constant battle against the second law of thermodynamics. As of late 2025, this machine—collectively known as the Wayback Machine—has archived over one trillion web pages.1 It holds 99 petabytes of unique data, a number that expands to over 212 petabytes when accounting for backups and redundancy.3

The scale of the operation is staggering, but the engineering challenge is even deeper. How do you build a machine that can ingest the sprawling, dynamic, and ever-changing World Wide Web in real-time? How do you store that data for centuries when the average hard drive lasts only a few years? And perhaps most critically, how do you pay for the electricity, the bandwidth, and the legal defense funds required to keep the lights on in an era where copyright law and digital preservation are locked in a high-stakes collision?

This report delves into the mechanics of the Internet Archive with the precision of a teardown. We will strip back the chassis to examine the custom-built PetaBox servers that heat the building without air conditioning. We will trace the evolution of the web crawlers—from the early tape-based dumps of Alexa Internet to the sophisticated browser-based bots of 2025. We will analyze the financial ledger of this non-profit giant, exploring how it survives on a budget that is a rounding error for its Silicon Valley neighbors. And finally, we will look to the future, where the “Decentralized Web” (DWeb) promises to fragment the Archive into a million pieces to ensure it can never be destroyed.5

To understand the Archive is to understand the physical reality of digital memory. It is a story of 20,000 hard drives, 45 miles of cabling, and a vision that began in 1996 with a simple, audacious goal: “Universal Access to All Knowledge”.7

Part I: The Thermodynamics of Memory

The PetaBox Architecture: Engineering for Density and Heat

The heart of the Internet Archive is the PetaBox, a storage server custom-designed by the Archive’s staff to solve a specific problem: storing massive amounts of data with minimal power consumption and heat generation. In the early 2000s, off-the-shelf enterprise storage solutions from giants like EMC or NetApp were prohibitively expensive and power-hungry. They were designed for high-speed transactional data—like banking systems or stock exchanges—where milliseconds of latency matter. Archival storage, however, has different requirements. It needs to be dense, cheap, and low-power.

Brewster Kahle, founder of Internet Archive (with the PetaBox behind him)

Brewster Kahle, the Archive’s founder and a computer engineer who had previously founded the supercomputer company Thinking Machines, approached the problem with a different philosophy. Instead of high-performance RAID arrays, the Archive built the PetaBox using consumer-grade parts. The design philosophy was radical for its time: use “Just a Bunch of Disks” (JBOD) rather than expensive RAID controllers, and handle data redundancy via software rather than hardware.

Editor’s Note: Read the rest of the story, at the below link.

Continue/Read Original Article Here: The Long Now of the Web: Inside the Internet Archive’s Fight Against Forgetting | HackerNoon

Tags: Architecture, Brewster Kahle, California, Fight Against Forgetting, HackerNoon, Internet Archive, Long Now, Memory, PetaBox, San Francisco, Storage, World Wide Web, WWW
#Architecture #BrewsterKahle #California #FightAgainstForgetting #HackerNoon #InternetArchive #LongNow #Memory #PetaBox #SanFrancisco #Storage #WorldWideWeb #WWW
Found this post in my bookmarks. Just downloaded it for later, but also reminded me of this #LongNow talk from '09 full of black humor and more than one story:

https://youtu.be/kySDKESt3_M
Social Collapse Best Practices | Dmitry Orlov

YouTube

Mapping Empires by Kate Crawford, Long Now Talks.

Crawford gives a tour through her detailed artwork Calculating Empires. Through examples ranging from Liebig’s critique of agriculture “robbing” soil nutrients, to Faraday’s latex insulation that devastated rubber forests, Crawford shows how technologies have long created “metabolic rifts”: systems that extract more than they regenerate.

https://longnow.org/talks/02025-crawford/

#AI #lecture #KateCrawford #LongNow

Kate Crawford: Mapping Empires

Launched by Stewart Brand in 02003, Long Now Talks has invited more than 400 leading thinkers to share their civilization-scale ideas.

Long Now
I got hyper fixated in a #LongNow talk about symbiogenesis and the chatbots and so I transcribed it because I couldn't find any transcription. https://reboil.com/mediawiki/What_is_Intelligence%3F_(Long_Now_Talk)
What is Intelligence? (Long Now Talk) - Reboil

Blaise Agüera y Arcas: What is Intelligence?

Launched by Stewart Brand in 02003, Long Now Talks has invited more than 400 leading thinkers to share their civilization-scale ideas.

Long Now

My two main takeaways from this wildly interesting talk:

1. Life (as Stephem Wolfram also thinks) is computational.

2. We are in cooperation with intelligent human and nonhuman beings so (to paraphrase Stewart Brand) we might as well get good at it.

https://longnow.org/talks/02025-aguera-y-arcas/

#life #intelligence #cooperation #longnow

Blaise Agüera y Arcas: What is Intelligence?

Launched by Stewart Brand in 02003, Long Now Talks has invited more than 400 leading thinkers to share their civilization-scale ideas.

Long Now

In which @Katecrawford takes the #LongNow stage talking "Mapping Empires" - YouTube LiveStream available, on 2pm AEDT so a good time-zone for Australians!

#STS

I think @attacus might like this

https://longnow.org/talks/02025-crawford/?hss_channel=lcp-43424

Kate Crawford: Mapping Empires

Launched by Stewart Brand in 02003, Long Now Talks has invited more than 400 leading thinkers to share their civilization-scale ideas.

Long Now

If you are inquisitive, I think you'll find this Seminar About Longterm Thinking (first link) at the Long Now Foundation very interesting. It's about emergent behaviour, replication and life, symbio-genesis, and their relation to computation. It's a great follow on to the previous talk (second link) about looking at life from the point of view of information theory.

#SALT #LongNow #computation #life

https://www.youtube.com/watch?v=KhSJuqDUJME

https://www.youtube.com/watch?v=zhzxQraB2m0

Blaise Agüera y Arcas | What is Intelligence? | Long Now Talks

YouTube