"...What makes this account particularly striking is Krikorian’s background. At Uber’s Advanced Technologies Center, he ran the team building autonomous vehicles and trained human safety drivers on exactly when and how to intervene when a self-driving system fails...."

🤔

LOL this is the problem with relying on AI tools, as well...

"...His core argument: Tesla is asking humans to supervise a system that is specifically designed to make supervision feel pointless. As he puts it, an unreliable machine keeps you alert, and a perfect machine needs no oversight, but one that works almost perfectly creates a trap where drivers trust it just enough to stop paying attention.

The research backs this up. Psychologists call it the “vigilance decrement”, monitoring a nearly perfect system is boring, boredom leads to mind-wandering, and drivers need 5 to 8 seconds to mentally reengage after an automated system hands control back. But emergencies unfold faster than that...."

#AI

@ai6yr every time

This publication comes to mind:

https://how.complexsystems.fail

As does a Human Factors lecture I attended last century (ugh) on the amount of money spent on psychological research to make fighter plane cockpits human-goof-proof, ON TOP of the extended, intense, and repeated training pilots go through.

One of the points in the early 90's was cars were becoming too complex for mere untrained humans to cope with, with next to no thought about the human-tech interface required.

@johannab @ai6yr it’s also where standards help and “innovation” breaks muscle memory and consistency. Cars have always had quirks and differences but increasingly their user interfaces are becoming so different between makes sometimes in small until it causes a crash ways
- I have two cars (a Volvo and a Kia) their interfaces do some things exactly opposite of each other (one you push up to control the windshields the other you push down) that’s minor

More major - their safety systems differ

@ai6yr @nazokiyoubinbou @Rycaut @johannab

This one time, I was driving a big pickup to transport a couch. Approaching the Bay Bridge in very heavy traffic, a motorcycle split the lanes past me.

A van in front of us abruptly changed lanes right in front of the bike without signaling.

I did not touch the pickup's brake pedal with my foot.

I let go of the steering wheel with my right hand and grabbed for a nonexistent front brake lever in mid-air like I was trying to sympathetically brake on the motorcyclist's behalf.

The bike saw the van move and dodged in time and was fine-- but it was the weirdest sensation, having my muscle memory cross over and kick in like that!