Who wants some good news?

Last week I spoke to a middle school class about cybersecurity as a career, and AI came up. I asked if they had tried to use LLMs to do their schoolwork—they all had. But every student in the class said it didn't work. Why?

"ChatGPT is too stupid."

Kids are alright.

@mttaggart

Wait...so ChatGPT can supposedly pass a bar exam, but it can't do 6th grade homework?

What is on bar exams anyway?

Did OpenAI’s GPT-4 really pass the bar exam?

The large language model’s claims of a top 10% score may have been relative to test-takers who had already failed the exam at least once, according to an MIT researcher.

Fast Company
@MylesRyden it depends on the goal of the questions you ask. If you ask the students to just repeat, chatGPT is good at it. If you ask questions that check if they understand, chatGPT fails (and some students fail, too) @mttaggart