@nixCraft yes. The way it is set up, it creates easily digestible plausible bullshit.
Easily, because there is no social, emotional or cognitive friction or effort needed. It starts responding immediately and pleasantly.
Digestible, because it is trained on the most often occurring sentences, contexts and words. No new language, no cognitive effort to understand or investigate underlying concepts, no awkward idiosyncratic language by other humans who think feel and express differently.
Plausible, because it is a language model, so the grammar and tone and words fit expectations, with a high probability.
Bullshit, because the output can be either correct or wrong, but it has no basis in reality.
Something makes a certain part of society very susceptible to this.