siderealLLM boosters: This is trained with all of the text and code on the public internet!
People who can fucking think: So it's extremely low quality, then?
"The average of everything on github" isn't badass code, it's unfinished student projects that never worked.
We hear "all the text on the internet" and we might think "well, they've sure digitized a lot of classic books, that must be good, right?" but then we realize that all of the books are maybe like 1% of the data. Most of it is like facebook messenger breakup arguments and semi-literate emails.
Jess👾
Malfunct (he/him)@JessTheUnstill @sidereal mostly they don't and it is a known issue in training.