Sinc0Jun 21, 2023
Dan Gillmor

Generative AI is creating so much garbage -- and then ingesting the garbage as "training data" -- that it's poisoning itself and what it produces. This would be hilarious except that so many people (and employers) still think this is a near-term fix for "problems" like having to pay human beings or, you know, do some thinking.

https://venturebeat.com/ai/the-ai-feedback-loop-researchers-warn-of-model-collapse-as-ai-trains-on-ai-generated-content/

The AI feedback loop: Researchers warn of ‘model collapse’ as AI trains on AI-generated content

As a generative AI training model is exposed to more AI-generated data, it performs worse, producing more errors, leading to model collapse.

VentureBeat
Jun 20, 2023 at 11:35pmWeb
Show threadTim HolmesJun 20, 2023
Well, that was quick…
Show threadKim Spence-Jones 🇬🇧😷Jun 20, 2023
@dangillmor Interesting. I have felt for a while that the most important regulatory input we need is to mandate that AI-generated content be tagged in some way, to prevent any feedback loops.
Show threadBruce Heerssen Jun 21, 2023
@dangillmor
Any rancher can tell you that you don't feed cows to your cattle.
Show threadFunHouse RadioJun 21, 2023
@dangillmor yup a feedback loop. Eventually the machine will just assume it's always right
Show threadFord EytouJun 21, 2023
@funhouseradio @dangillmor Sounds like it will run for office soon.
Show threadHunter PerrinJun 21, 2023
@funhouseradio @dangillmor It already does that because it was trained on Reddit comments.
Show threadMilquetoast Jun 21, 2023
@dangillmor a copy of a copy of a copy of a copy ...
Show threadCavyherdJun 21, 2023

@dangillmor

They should be calling it Regurgitative AI

Show threadMxhradJun 21, 2023
@dangillmor It'll be hilarious when their businesses fail because no one wants the crap they generate.
Show threadMITFlunkieJun 21, 2023
@dangillmor As someone who has been watching the right-wing circle the drain, I NEVER would have believed this sort of feedback loop could happen.
Show threadKevin SchwarzJun 23, 2023
@dangillmor Garbage in Garbage out