Does anyone have saved examples of scientific citations / reference lists generated by #ChatGPT from a few weeks / months ago? I'm quite curious whether its citation generating behavior has changed but wasn't smart enough to save output from when it was first released.

I'm quite puzzled as to whether #ChatGPT has gotten better with citations or not.

On one hand, it wrote a paper for me about bullshit that contained only references to actual papers. I don't think it used to be able to do that.

On the other, it also wrote an entire essay about a single paper that doesn't even exist, complete with a live hotlink to a 404.

After an evening of playing around, I'm wondering if the change is not any kind of patch to the code itself that I drifted to giving it easier prompts for which it has a fuller training set and less need to fabricate references.

The more offbeat the topic, the more fabricated references I get. Some not completely crazy topics (the physics of asparagus) feature only fabricated references.

@ct_bergstrom Yeah, I got 100% fabricated references in my query about selective mutism among hermit crabs…go figure.