I asked #chatgpt to write me an essay, with citations, about a scientific topic I know very well (bat crawling behaviour). It wrote a bad essay that didn’t really say much, but cited two papers with which I wasn’t familiar, in very good journals. I was freaked out! How did I not know those papers?
Turns out, chatgpt just made them up. The papers don’t exist. That’s a handy thing to know.