The AI feedback loop: Researchers warn of ‘model collapse’ as AI trains on AI-generated content
The AI feedback loop: Researchers warn of ‘model collapse’ as AI trains on AI-generated content
I mean it makes sense. Machine learning is fantastic at noticing patterns, and the stuff they generate most definitely do have patterns. We might not notice them, but the models will pick up on them and eventually, if you keep training them on that data, they’ll skew more and more in that direction.
They’ve been marketing things like there isn’t a limit to how good these things can get, but there is. Nothing is infinite.