Should handymen use AI to fix your electric outlets? New Mozilla project says yes!

cross-posted from: https://piefed.social/c/technology/p/1903357/should-handymen-use-ai-to-fix-your-electric-outlets-new-mozilla-project-says-yes

In an obscure post, a Mozilla MLE announced a ClawBot ripoff specifically targeted at at tradespeople (electricians, plumbers, roofers, handymen) for help with administrative tasks like scheduling, explaining invoices, etc.

What is their project, ClawBolt? According to their website, it’s a compilation of

  • A flaky AI agent you run on your computer
  • A Telegram chatbot to remotely control it
  • A connection to OpenAI to parse all of it

This sounds like a dangerous project to target at tradesmen, doesn’t it? AI marketing tells people that AI is smart and safe and powerful when it is anything but. If Facebook’s top AI safety genius nearly destroyed her own email inbox, how will a plumber fare?

One of the features of ClawBolt is “memory,” something that will store and possibly corrupt questions and answers like “What’s Mrs. Johnson’s address?” and “My hourly rate is $95”.

But it gets worse: ClawBolt documentation says it can scan images to “get help identifying fixtures

Remember the memes making fun of AI’s inability to make wiring diagrams?

I can only imagine how bad this could make things for tradespeople - in addition to violating customer privacy, getting gaslit by a non-deterministic “memory” machine, and potentially breaking their work computers.

Just think of how profitable it will be to be an Insurance underwriter once all the electrical fires start.
a live ground pin would be pretty silly
At least Earth isn’t live. Or metal.
“touch grass” bro i’d get electrocuted
That’s safe, just a waste. Right?
And to think I’ve been ignoring “earth” all this time.
Earth —›
What?! It got one wire right. That’s enough, right?

Ah sure, altering current will make up for it somehow I guess.

/s

What did it get right?
AI is generally garbage, but I refuse to judge AI output until I see the actual prompt that generated it. Who knows the they actually asked for. The prompt could have been “generate an image showing how to wire a plug so that it will kill the next person that touches it”.
So you’ll never judge AI, because people normally don’t share their prompts?
I’ve seen enough output from my own prompts to know that it usually produces garbage.
Judge AI cause it has generated a potentially dangerous scenario. 

AI like this reminds me of Flowers for Algernon when he starts using punctuation everywhere because, knowing but that he’s doing it wrong but he does it anyway.

You got to mix them up, she showed? me" how to mix! them (and now; I can! mix up all kinds" of punctuation, in! my writing? There, are lots! of rules? to lern; but Im gettin’g them in my head.

Nobody asked for this, nobody needs this.

Slop wires start fires.

“Line----->” goes hard

Funny that you mention this now.

A few days ago we had to splice an euro plug into a US cable (we needed it urgently and the replacement was going to take too long to arrive). Once we had cut the cables we found out that the color schemes for the wires are different in the US than the EU, so a coworker asked chatgpt which wires he should connect together. Long story short, the fuses got tested that day, and not intentionally. He ended up connecting live to ground.

I dunno. Maybe AI is the new “Darwinism.”

If you are stupid enough to use AI for electrical systems (or anything else crucial), the human race doesn’t need you.

The problem, much like the problem with relying on evolution to unfuck the anthropocene mass extinction event, is that the response rate of the feedback mechanism is far too slow. By the time an AI-reliant contractor ends up personally experiencing the “find out” result of their particularly stupid brand of “fucking around”, they will have potentially caused irreparable damage to the lives of —and potentially caused the deaths of— hundreds of otherwise-reasonable people.