nixCraft 🐧Oct 17
the irony of this is that Perplexity is posting this one 🤣
Show threadCaden
@nixCraft model collapse sounds like a saving grace to me
Oct 17 at 4:12amWeb
Show threadXylightOct 17

@tarix29 @nixCraft I thought this too, but then I learned that a lot of modern LLMs are trained on intentionally synthesized/AI generated data.

the only one I know for a fact was is gpt-oss, but I'm sure the other big ones do too.

so unfortunately model collapse wont really affect these guys that much

Show threadFahri Reza 🍉Oct 17

@Xylight @tarix29 @nixCraft I think that is just how they create generative AI model

they have one model that generates random samples and one model that judges whether the samples look like somethings that human creates

the closer that the first model in compliance with the second model you have a generative AI model