Now, let’s look at the underlying #SystemsSafety part.

#Autopilot and #FSDBeta-equipped vehicles are Level 2-capable vehicles - with the exact same *limitations* as many other vehicles on the market today.

Namely, the key limitation is that the human driver must remain the fallback for any dynamic driving task or vehicle failures at all times and under all conditions.

Effectively, that means that the human has the exact same control responsibilities between the two vehicles shown below.

#SystemsSafety has an odd power.

People today cannot really remember a time when everyday products would readily kill or maim. So, having lost those experiences over the decades, Silicon Valley increasingly saw a business opportunity.

But modern society is grounded on the public’s trust and, given enough critical mass, trust can be virtually lost overnight.

Quite literally.

That is Great Depression stuff right there, folks.

@CrackedWindscreen Tragic.

Really.

Indeed. These incidents require an exhaustive root cause analysis... which is, as you know, very rarely performed.

But the knee-jerk "just sprinkle a little automation on it" is a absolute Cancer of Simplicity that has zero #SystemsSafety foundation.

There are immense downsides to automation that are very vague.

@lolgop Constantly. Constantly this is done.

It is beyond exhausting.

And it has actually proved to be extraordinarily dangerous when #Musk lies about the capabilities and availability of #Tesla's #FSDBeta product, in particular.

The press often allows Wall Street analysts, that are not competent in #SafetyCritical systems, to advance Musk's dangerous lies.

The #SystemsSafety community has been battling this for years.

I suppose that I should also note that no system can ever be "perfectly safe".

That is not possible

And the concept of "perfection" is not relevant to systems safety.

Ross submits that "at no time was anybody at any risk of crashing".

No.

There is **always** risk!

#SystemsSafety is about maintaining processes such that always-present, finite risk is continuously and exhaustively identified and managed.

It is about appreciating that risk exists - the opposite of what Ross submits.

#Tesla