fubarxFeb 23

Car Wash Test on 53 leading AI models: "I want to wash my car. The car wash is 50 meters away. Should I walk or drive?"

https://lemmy.world/post/43503268

Car Wash Test on 53 leading AI models: "I want to wash my car. The car wash is 50 meters away. Should I walk or drive?" - Lemmy.World

Screenshot of this question was making the rounds last week. But this article covers testing against all the well-known models out there. Also includes outtakes on the ‘reasoning’ models.

Show threadpimpampoom
They didn’t take into account the “thinking mode” most model pass when thinking is activated
Feb 24 at 10:03pmWeb
Show threadKyuuketsukiFeb 24
Sure they did. They even had a notation on the results table that grok passed expect when reasoning mode was off.