We knew, but the proof is nice.

"Apple just proved that AI models cannot do math. Not advanced math. Grade school math. The kind a 10-year-old solves"

The guess-the-next-words machines don’t actually understand anything.

https://nitter.poast.org/heynavtoor/status/2041243558833987600#m

#math #ai

@davidaugust did you see the documentary about "Project Nim", the monkey who got adopted and was supposed to be speaking sign language?

there have been other monkeys showing the same effect of this highly sophisticated begging where the monkeys guess the expected behavior but do not understand

they answer with some sign but they do not understand that there was a question nor that they do give an answer

they see human behavior and from pattern matching they do what they think is appropriate for that moment because it had served them well in the past

its hard for me to explain but the documentary did a good job in preparing me for the sophistcated begging of llms

i wanted it to be true to communicate with monkeys but the documentary gave me a werner herzog umderstanding of the beauty of standing apart, watching each other over a unbridgeable chasm

@drifthood yes, there does seem to be a threshold over which in some respects only humans cross over to one side.

I see that sort of begging in a dog. He wants the treat, so instead of just doing the desired behavior the human command is asking for, he tries every response that has ever gotten him a treat until he “unlocks” the treat. Humans can and do do this too from time to time, but humans _also_ actually communicate and understand from time to time as well.