I have a vague hypothesis that I am utterly unprepared to make rigorous that the more of what you take into your mind is the result of another human mind, rather than the result of a nonhuman process operating on its own terms, the more likely you are to have mental issues.
On the low end this would include the documented protective effect of natural environments against psychotic episodes compared to urban environments (where EVERYTHING was put there by someone’s idea). But computers… they are amplifiers of things put out by human minds, with very short feedback loops. Everything is ultimately in one way or another defined by a person who put it there, even it is then allowed to act according to the rules you laid down.
And then an LLM is the ultimate distillation of the short feedback loop, feeding back whatever you shovel into it straight back at you. Even just mathematically - the whole ‘transformer’ architecture is just a way to take imputed semantic meanings of tokens early in the stream and jiggling them around to ‘transform’ that information into the later tokens of the stream, no new information is really entering it it is just moving around what you put into it and feeding it back at you in a different form.
Commentary straight from some of the sources
lesswrong.com/…/stone-age-billionaire-can-t-words…
Comments are fun
So.
How much of this is folding all the meme stocks into the one thing that actually produces a product that people all over the world demonstrably want to pay for over the competition to keep their stupid plates spinning?
And how much is religious psychosis, advancing along the singulatarian eschatology from AI to dyson sphere to rebuilding the universe in His Image?
I can’t tell.