Dr. Damien P. Williams, MagusMar 18, 2024

So about five days ago, or so, people on Bsky and Twttr started highlighting Elsevier science papers with GPT/LLM hallmark phrases riddled all throughout them. [Dozens and dozens (at least)] of peer-reviewed papers.

As I said, then, and as I discussed in my dissertation, knowledge-making and expertise are always a tricky process, but it needs deep, intentional confrontation and reform:
https://media.proquest.com/media/hms/PRVW/1/twSaS?_s=yIAhHtzhif4xd76I%2BihtcJJXTPw%3D

Anyway, now it looks like @404mediaco has dug down on this, and found *Even More of It* and I am genuinely and completely struggling against despair at what the future of being an educator, researcher, and writer will even mean over and at the end of the next 5 years.
https://www.404media.co/scientific-journals-are-publishing-papers-with-ai-generated-text/

Quite frankly, this should genuinely a) be the death of peer review as we know it (Again: AS WE KNOW IT), and b) lead a complete reformulation of the knowledge-making and expertise processes, but it won't and that terrifies and saddens me.

Show threadMatt HodgkinsonMar 18, 2024
@Wolven @404mediaco Are you sure it's thousands of peer-reviewed papers? I'd love to see the evidence. Paper mills have certainly published many thousands of articles, but most of those including AI shibboleths seem to be in predatory journals, preprints, and grey literature.
Show threadDr. Damien P. Williams, MagusMar 18, 2024
@mattjhodgkinson I may be misremembering the total, or misapplying it to "AI" papers in particular, when it was about deceptive practices as a whole. Going to tag @gcabanac in to help clarify (does most of the research I'm talking about), and I'll amend my language in the post in the meantime. @404mediaco
Show threadAlanMar 19, 2024
@Wolven @mattjhodgkinson @gcabanac @404mediaco is it possible that LLM were trained on these Elsevier papers and the hallmark phrases are recognizable regurgitations? Elsevier seems like it would happily charge a fee and let AI companies have at their database - especially since they may accept papers under terms that gives them the legal control to do so
Show threadMatt Hodgkinson
@metaphase @Wolven @gcabanac @404mediaco These are conversational markers of someone using ChatGPT.
Mar 19, 2024 at 3:41pmWeb