There's magic trick that can make any #AI project successful. When the LLM's success rate is too low, just say "it's OK, we will have a human in the loop" and ship it anyway.

There's just one problem with this magic trick: most #LLM implementations don't have the thoughtful and intentional guard rails that would make this a real human-in-the-loop system.

Instead, the loop becomes a vicious cycle of deception and deskilling, losing all benefits of oversight.

https://productpicnic.beehiiv.com/p/human-in-the-loop-is-a-thought-terminating-cliche

"Human in the loop" is a thought-terminating cliche

Without thoughtful guard rails, asking people to clean up after machines doesn't make machines better — it makes people worse.

The Product Picnic
Thanks to @RuthMalan @TimWardCam @mipsytipsy @scottjenson @tante @justinsheehy and everyone else not yet on fedi for the ideas featured in this week's Product Picnic!
@PavelASamsonov oh jeez, thank you so much for tagging me here! i've had this link open in a tab for months due to the snappy title, but this actually made me read it, and it is _fire_.
@PavelASamsonov thanks for sharing these thoughts. The QA-by-inspection problem goes back even further than computer automation. It was understood by political theorists in the 19th century as it pertains to institutional decision-making. https://scholar.social/@jrbe/114859289777957944
James R.B. Eastwood (@[email protected])

Attached: 1 image John Stuart Mill explains why human-in-the-loop is the worst possible decision scheme: "... the mind is called into far more vigorous action by being required to propose than by merely being called on to assent.... A body whose only recognized function was to find fault, would speedily let that function fall into desuetude." From the East India Company's 1858 Petition to Parliament, which Alexander Bain attributes almost entirely to JSM.

Scholar Social
Dr. Maddkap, Werepsychologist (@[email protected])

THEM: We want to make sure there is always human intervention with AI content. We call it having a "human in the loop to edit and review" AI responses. ME: ... Human In The Loop to Edit and Review ... you know that abbreviates as HITLER, right? THEM: What? Oh ... crap.

meow.social - the meowstodon instance for creatures fluffy, scaly and otherwise