@nixCraft If you switch out ChatGPT in that dialog with a human being, this person is just an asshole.
So ChatGPT is in fact an asshole, nothing more, nothing less.
@nixCraft wasn't there case where chatgpt recommended a man to use sodium bromide instead of sodium chloride to eat and developed rare disease.
Preface: I'm not an AI apologist.
This hypothetical scenario does not support an argument about the reliability of AI, and the user is at fault for finding themselves in the emergency ward.
If you're pragmatic with the way you use AI, it's an incredibly powerful tool. It's a skill, though -- not magic. You do need to learn how to use it efficiently.
If you're using it to help you accomplish something which will have actual consequences, then it's on you to be careful.