Carl T. BergstromSep 8, 2024

We're so fucked.

"Our analysis of a selection of questionable GPT-fabricated scientific papers found in Google Scholar shows that many are about applied, often controversial topics susceptible to disinformation: the environment, health, and computing. The resulting enhanced potential for malicious manipulation of society’s evidence base, particularly in politically divisive domains, is a growing concern."

https://misinforeview.hks.harvard.edu/article/gpt-fabricated-scientific-papers-on-google-scholar-key-features-spread-and-implications-for-preempting-evidence-manipulation/

GPT-fabricated scientific papers on Google Scholar: Key features, spread, and implications for preempting evidence manipulation | HKS Misinformation Review

Academic journals, archives, and repositories are seeing an increasing number of questionable research papers clearly produced using generative AI. They are often created with widely available, general-purpose AI applications, most likely ChatGPT, and mimic scientific writing. Google Scholar easily locates and lists these questionable papers alongside reputable, quality-controlled research. Our analysis of a selection of

Misinformation Review
Show threadcobalt going beige today
@ct_bergstrom Oh wow, the scholarly papers already a majority of those cited: "Roughly two-thirds of the retrieved papers were found to have been produced, at least in part, through undisclosed, potentially deceptive use of GPT. The majority (57%) of these questionable papers dealt with policy-relevant subjects (i.e., environment, health, computing), susceptible to influence operations. Most were available in several copies on different domains (e.g., social media, archives, and repositories)"
Sep 8, 2024 at 3:50amWeb
Show threadMichael BuschSep 8, 2024

@cobalt @ct_bergstrom I note "A sample of scientific papers with signs of GPT-use found on Google Scholar was retrieved".

So a majority of the papers that were flagged as potentially fraudulent were in fact made using the text generator.

That is already quite bad enough, since the number of fraudulent papers indexed by Google Scholar with just a couple of obvious tells of ChatGPT is apparently >100.