Does anyone have saved examples of scientific citations / reference lists generated by #ChatGPT from a few weeks / months ago? I'm quite curious whether its citation generating behavior has changed but wasn't smart enough to save output from when it was first released.

I'm quite puzzled as to whether #ChatGPT has gotten better with citations or not.

On one hand, it wrote a paper for me about bullshit that contained only references to actual papers. I don't think it used to be able to do that.

On the other, it also wrote an entire essay about a single paper that doesn't even exist, complete with a live hotlink to a 404.

After an evening of playing around, I'm wondering if the change is not any kind of patch to the code itself that I drifted to giving it easier prompts for which it has a fuller training set and less need to fabricate references.

The more offbeat the topic, the more fabricated references I get. Some not completely crazy topics (the physics of asparagus) feature only fabricated references.

That said, I'm heartbroken that this is not a real paper.

Salinas-Melgoza, A., Taylor, A. H., and Seed, A. (2020). Wild crows discriminate objects based on their physical properties and cause a small fire to obtain food. Scientific Reports, 10(1), 1-7.

@ct_bergstrom
At least it didn't claim crows had learned to use AI to write code to earn their food.