Outsourcing your thinking to AI is a... choice.

https://lemmy.world/post/45245469

To be honest, for a lot of people this is a good decision. AI is already better at cognition and research than a fairly good chunk of the population. If they start thinking at a reasonable level with the help of AI, we all will benefit. Obviously Grok isn’t the best choice but still probably better than what a lot of them would come up with on their own.
I’m going to assume you’re saying this in good faith. The problem with handing thinking over to a computer is not just about computers being worse thinkers, it is also about the fact that these computer systems are being conditioned to reflect the views of the organizations that created them. This creates a concentration of power issue as it’s another avenue to influence how people think, and it’s a pretty strong one at that if people are literally handing over their thinking. This problem is likely to get worse over time as selling this influence in the same way much of the internet sells ad space will likely be quite profitable, and we’re probably not seeing it as much now because AI companies are trying to get their LLMs integrated into society so people become dependent on them.

it is also about the fact that these computer systems are being conditioned to reflect the views of the organizations that created them

And people aren’t? Have you spoken with a Trump supporter recently? They are far more programmed than any modern AI engine. I’d take any modern AI programming them over whoever’s currently doing it.

I do agree with you that this will probably be a problem in the future, but for the time being, for those people at least, I do think it’s a net positive.

I did say that it’s another avenue to influence how people think. Even if it were a small net positive right now, which I would argue that it’s not but I digress, it’s only serving to strengthen people’s dependence and trust of the systems which will overwhelmingly likely be used to control them in the future.
Targeted LLM labotomization turns out to be very difficult. You can still get Grok to shit on Musk.
But you need to spend effort to do that, and if you don’t know the actual truth and realize grok doesn’t provide that, how would you do that?

I haven’t used grok personally, but on gemini it’s not too hard to get it to shit on the oligarchs. Even basically got it to admit killing Trump would be a net positive to society without much effort.

I do agree in principle that LLMs work much better in cases where you can verify the output quickly but getting there would be difficult, so NP problems basically.

I’m in a weird position with LLMs because I have found them absolutely invaluable as a learning tool, but also recognize how much damage they could do to society, especially in the hands of dumber people when it comes to propagandization.