I couldn't convince ChatGPT that the capital of West Virginia is Huntington (it's not, it's Charleston), until I told it to check wv.gov (which of course it cannot do), which caused it to finally concede the point.

Consider this your periodic reminder that ChatGPT doesn't "think" anything but is just completing sentences with statistically-likely conclusions.

@waldoj the other thing that keeps it from being reliable is that it cannot say “I don’t know” which means it just makes up answers.
In coding, I’ve found that it just fabricates built-in functions when it can’t figure out an answer.

@ChamomileHangover @waldoj ChatGPT will quite regularly tell me when it feels that it’s not possible for it to do something.

There are certainly myriad examples of ChatGPT flat-out making stuff up.

There are *also* myriad examples of people *maliciously* getting it to say something incorrect.

Both of these are flaws, and both of these could have dire consequences if the tech is misused, but both of them should be considered fairly separately. The ‘turns out’ shovelware opinion pieces and social media posts tend to be the latter. People that conflate the two are at best not smart / knowledgeable enough to be any sort of authority on this subject, and are at worst bring intentionally misleading.

The ChatGPT cheerleaders cop a lot of shit online but there’s just as many internet points to be had by hoodwinking people into conflating blind skepticism and contrarianism with intelligence or wisdom.

Most people talking about this in anything more than a “family barbecue” context are having more nuanced discussions than “conscious or not”. L

@ChamomileHangover @waldoj tell me about it!

"Write me a php script to proxy a webcam image"

Bard:

$webcam = new Webcam();

Wait, what?