fubarxFeb 23

Car Wash Test on 53 leading AI models: "I want to wash my car. The car wash is 50 meters away. Should I walk or drive?"

https://lemmy.world/post/43503268

Car Wash Test on 53 leading AI models: "I want to wash my car. The car wash is 50 meters away. Should I walk or drive?" - Lemmy.World

Screenshot of this question was making the rounds last week. But this article covers testing against all the well-known models out there. Also includes outtakes on the ‘reasoning’ models.

Show threadCetaceanNeeded

I asked my locally hosted Qwen3 14B, it thought for 5 minutes and then gave the correct answer for the correct reason (it did also mention efficiency).

Hilariously one of the suggested follow ups in Open Web UI was “What if I don’t have a car - can I still wash it?”

Feb 24 at 11:57pmWeb
Show threadhaitchFeb 25
A follow up I got from my Open WebUI was “Is walking the car to the wash safer than driving it there?”
Show threadWolfLinkFeb 25

My locally hosted Qwen3 30b said “Walk” including this awesome line:

**Why you might hesitate (and why it’s wrong):

  • X “But it’s a car wash!” -> No, the car doesn’t need to drive there—you do.

Note that I just asked the Ollama app, I didn’t alter or remove the default system prompt nor did I force it to answer in a specific format like in the article.