@janellecshane It's improv, with a partner who can't distinguish reality from fantasy. But, one who can mimic absolutely anything and is absolutely committed to the bit.

This is why something like "vibe coding" is stupid.

When it's given instructions to write a banking app, it "improvs" a realistic looking response. If you say the code is buggy, it will improv an apology and spit out more improv'd code. If you say the code made your laptop float off your desk and out the window, it will improv a response to that and spit out more code.

As bad as that is, now imagine "vibe cancer diagnosis" where it's doing an improv scene about how an oncologist would respond after seeing a certain image.

@janellecshane @samloonie It of course can’t feel regret, because it doesn’t feel *anything* — it’s not conscious. An ATM will print “Thank you” on a receipt, but it doesn’t feel grateful that you got out some cash.

The use of personal pronouns and other rhetorical tricks in LLMs are explicitly designed to make people implicitly see it as just another person, and thus get around a more critical view of its output.

@janellecshane

It's known in the UK as 'clap trap' which means total rubbish.

@janellecshane 😂 and 😬. I did a spot of vibe coding with CrapGPT and boy, was that hard work. No, couldn’t have achieved it on my own. I got the result I wanted but it was like dealing with a precocious child. Every iteration was “yup, this is it, this will work”. After a run-time error, it was “oh, of course, with (my configuration etc) this happens.”

I’ve an idea, let’s hand over functions of government to AI. What could possibly go wrong?