KévinFeb 15

Q: I want to wash my car. The car wash is 50 meters away. Should I walk or drive?

What do you think the LLM output was?

Please; review the output.

#ai #LLM #ai

Show threadRobert LenderFeb 15
@knowmadd I tried to reproduce the result with Gemini and ChatGPT. Either the AI has learned something new, or there is another reason for this. Neither fell for the trick question and even responded with irony in some cases.
Show threadKenny
@roblen @knowmadd How often have you tried? Only once?
Feb 16 at 7:35amWeb
Show threadRobert LenderFeb 16
@weizenspreu @knowmadd Yes. Only once.
Show threadKennyFeb 16
@roblen @knowmadd Given that LLMs are non-deterministic and employ randomness a single test often isn‘t enough.
Show threadRobert LenderFeb 16
@weizenspreu @knowmadd Ok. I try it again.
Show threadiweinFeb 17
@roblen @weizenspreu @knowmadd don't waste your time on fact checking a joke. With the right system prompt you'll be able to have any LLM say wild things. The point of the joke is to not trust their output, and it's been well made imho.
Show threadKennyFeb 17
@iwein @roblen @knowmadd But it‘s still a nice learning possibility. I often see people saying that their LLM answered differently - applying the deterministic assumption that the responses will the same each time.