I saw a post that started, "The most dangerous thing about ChatGPT is..." and finished by describing a situation where ChatGPT gave a confident seeming and incorrect answer.

To me, the output is indistinguishable from the glib, confident, yet incorrect statements made by politicians and people who are wrong on the internet.

So, let's finish that sentence. IMO, "The most dangerous thing about ChatGPT is that people actually listen to it."

No. I won't debate you on this point.