Today is Stanislav Petrov Day. It's a day when I take some time to reflect on the importance of questioning technology. Because that is what Stanislav Petrov did when he averted nuclear war on September 26 in 1983.

"We can't wait anymore."
"7 minutes until the first warhead is in the observation zone."
"We won't have time to retaliate. You have to make a decision!"
"You see it?"
"Could be."
"No. That's not heat from a missile."
"Damn!"
"Let's keep looking."
"THE COMPUTER CAN'T BE WRONG!"
"I don't understand it."
"Damn it! They have to confirm this damn attack."
"All thirty levels of security levels confirms the attack!"
"Infrared devices verify heat from all five launched missiles!"
"What are we going to do?"

Stanislav Petrov: "Nothing. I don't trust the computer. We'll wait."

This dialogue is from a re-enactment in the documentary The Man Who Saved the World.

Last year I wrote about three learnings I take away from his story.

1. Embrace multiple perspectives.
Petrov was educated as an engineer rather than a military man. He knew the unpredictability of machine output.

2. Look for multiple confirmation points.
To confirm our beliefs we should expect many different variables to line up and tell us the same story. If one or more variables are saying something different, we need to pursue those anomalies to understand why. If the idea of a faulty system lines up with all other variables, that makes it more likely.

3. Reward exposure of faulty systems.
If we keep praising our tools for their excellence and efficiency it's hard to later accept their defects. When shortcomings are found, this needs to be communicated just as clearly and widely as successes.  Maintaining an illusion of perfect, neutral and flawless systems will keep people from questioning the systems when the systems need to be questioned.

https://axbom.com/lessons-from-stanislav-petrov/
Three lessons from a man who averted nuclear war by not trusting a computer

On September 26, 1983, Stanislav Petrov made the correct decision to not trust a computer. The early warning system at command center Serpukhov-15, loudly alerting of a nuclear attack from the United States, was of course modern and up-to-date. Stanislav Petrov was in charge, working his second shift in place

Axbom β€’ My Next Heartbeat
@axbom that third lesson was a big element in the Chernobyl disaster

@axbom

the man who saved the world by doing nothing

I don't like the term "hero" (especially when it comes to soldiers)

but in this case I make an exception

@ChristophBuck @axbom He did a lot more than nothing. He observed, he questioned, he chose to not react based on fear, he trusted his observations over tech & pressure.

Crucial skills we all need to develop if we wish to see positive change on this planet. First & foremost choose to shut out the fear-mongering & make conscious choices / take action based on observation & inner knowing.

He acted as a responsible member of our human collective, understanding that his choice impacted us all.

@savagedaughterscollective @axbom

It's funny how not acting would solve a lot of problems these days.

not driving
not buying
not producing
not burning
not shooting

and yes, you can observe and question a lot in advance if thats your thing

It still strucks me that doing nothing is almost never seen as a solution, even though it would save our asses today just as much as it did back then.

@ChristophBuck @axbom Choosing to NOT act in a specific way IS choosing to act in an alternative manner. That's the point.

Observing, questioning, thinking & behaving based on what is best for our collective & our home - this planet - are abilities we have lost....and we see where this has gotten us....to right where we sit now. Not too many people are enjoying this.

The guy mentioned in the original post chose to act in that manner. That's the only difference between 'heroes' & non-heroes.

@axbom these thoughts even more relevant in times of an emerging supposedly omniscient AI

@axbom HAL 9000 never made a "mistake", until it did.

Fiction and reality sometimes converge.

@axbom

At a more prosaic level, the type of thinking that protects against various scam artists.

"Quick: you must act now! It's urgent!"

"Really? I'll take a moment to think it over."

@Doug_Bostrom As in β€œQuick! You must invest in AI now!” 😊
@axbom I see I am your 109th booster 😊 Thanks, it is very interesting and you taught me something.
@axbom And there I was already almost asleep, in bed typing 9 instead of 0, I was the 100th 🀣
@axbom He is an international hero for what he did not do.
@axbom This is actually an argument to put the human out of the loop for the Mutually Assured Destruction (MAD) doctrine: When confronted with a nuclear attack there are two possibilities:
1) Computer is right: You will die no matter what you do.
2) Computer is wrong: Now your actions matter.
You have two options:
A) "Retaliate": You start a nuclear war and you die.
B) Do nothing: You prevent a nuclear war and you be a hero.
The logical thing for a human is to never retaliate, breaking MAD.

@axbom hopefully ChatGPT will help those tasked with interpreting machine output to question those decisions.

A problem there though is that it is designed for plausibility which is tantamount to design for deception. πŸ€¦β€β™‚οΈ

@axbom he also, critically, questioned authority.