siderealMar 1

LLM boosters: This is trained with all of the text and code on the public internet!

People who can fucking think: So it's extremely low quality, then?

Show threadsiderealMar 1
"The average of everything on github" isn't badass code, it's unfinished student projects that never worked.
Show threadsiderealMar 1
We hear "all the text on the internet" and we might think "well, they've sure digitized a lot of classic books, that must be good, right?" but then we realize that all of the books are maybe like 1% of the data. Most of it is like facebook messenger breakup arguments and semi-literate emails.
Show threadSusan CalvinMar 1
@sidereal they've presumably pulled all the bad fanfic as well as the Epstein Files....
Show threadChip ButtyMar 1
@Susan_calvin @sidereal LLMs follow Sturgeon's Law
Show threadSusan Calvin
@otfrom @sidereal Sturgeon's law allows for the possibility of some good material amidst the dross. I don't think it applies to LLMs.
Mar 1 at 5:25pmMastodon for Android
Show threadChip ButtyMar 1
@Susan_calvin @sidereal fair