At a conference in Helsinki last year, I had a discussion with Ron Chrisley about language models. One of the things he wagered they couldn't do was mental imagery, and he used an old set of cogsci probes on mental imagery that GPT-3 failed miserably at. One of them included mental rotation, like turning a letter in your head to see what other letter it forms. Well, here's ChatGPT's first shot at it:
[email protected]:
What letter do you get if you rotate the letter 'p' 180 degrees?
[email protected]:
What letter do you get if you rotate the letter 'p' 180 degrees?