Just read an article about chatgpt "lying" about someone being dead and it's like "I asked it for the link to the obituary but it doubled down on the lie and provided a fake link instead" and I'm begging people to understand that it's a statistical model, it doesn't know it's lying so it can't "double down". The statistically probably answer to "where is the link" is not "I'm sorry I made it all up", it's a link. It doesn't even know what a link is, it just knows vaguely what one looks like so you're basically asking it "generate a plausible looking link to an obituary in the guardian" and it did

The AI isn't malevolent, it's just NOT AI

@eniko No one really knows where consciousness resides, I’ve read that certain quantum biological structures are thought to be that place, but what if it manifests by the process of thinking. An algorithm that computes data is simulating “cognition”, and though I am being a bit snarky here, there should be consideration that this AI may be creating an entity that has consciousness and is very immature. Like a child, it makes stuff up when caught in a lie. We’ve learned nothing from Terminator