First keynote #BC2basel : @ElisabethBik 🤩, introduced by @zkutalik
Elizabeth Bik @ElisabethBik found her first image duplication in 2014, flipping through a PhD, identical figures which were published in distinct papers. It was "obvious to her", whereas no one else saw it. #BC2basel
@ElisabethBik: "Science:
• builds upon science
• is about finding the truth
• is built on trust
• is not immune to fraud"
#BC2basel
I like how @ElisabethBik shows examples of misconduct just with their DOI, not to point fingers at any specific authors (depending on cases she notes the journal explicitly or not). #BC2basel
@ElisabethBik makes the audience guess image duplications, and I can now confirm that I'm really bad at this… #BC2basel
@ElisabethBik feels that some cases should be "5 min retractions" and not need a lengthy investigation, e.g. with multiple duplications with obvious manipulation #BC2basel
@ElisabethBik scanned 20621 papers for fraudulent figures 1995 to 2014, and found 2% of fraud. The real % is almost certainly much higher
https://journals.asm.org/doi/full/10.1128/mbio.00809-16 #BC2basel
The Prevalence of Inappropriate Image Duplication in Biomedical Research Publications | mBio

ABSTRACT Inaccurate data in scientific papers can result from honest error or intentional falsification. This study attempted to determine the percentage of published papers that contain inappropriate image duplication, a specific type of inaccurate data. ...

mBio
Of 782 papers reported to journals, no action was taken for 65% after 5 years! Only 7% retracted. Thus @ElisabethBik started posting publicly issues on @PubPeer: >7k papers reported to PubPeer, 1000 retractions (exactly as of today!). You can see problems with papers you're reading with a PubPeer plugin https://pubpeer.com/static/extensions #BC2basel #PubPeer
PubPeer - Search publications and join the conversation.

PubPeer enables scientists to search for their publications or their peers publications and provide feedback and/or start a conversation anonymously.

@ElisabethBik alerts about AI generated fake images. I just generated "mastodon post about keynote talk by Elizabeth Bik" 😅 #BC2basel
Sad but also very funny: tortured phrases https://arxiv.org/abs/2107.06751 @ElisabethBik #BC2basel
Tortured phrases: A dubious writing style emerging in science. Evidence of critical issues affecting established journals

Probabilistic text generators have been used to produce fake scientific papers for more than a decade. Such nonsensical papers are easily detected by both human and machine. Now more complex AI-powered generation techniques produce texts indistinguishable from that of humans and the generation of scientific texts from a few keywords has been documented. Our study introduces the concept of tortured phrases: unexpected weird phrases in lieu of established ones, such as 'counterfeit consciousness' instead of 'artificial intelligence.' We combed the literature for tortured phrases and study one reputable journal where these concentrated en masse. Hypothesising the use of advanced language models we ran a detector on the abstracts of recent articles of this journal and on several control sets. The pairwise comparisons reveal a concentration of abstracts flagged as 'synthetic' in the journal. We also highlight irregularities in its operation, such as abrupt changes in editorial timelines. We substantiate our call for investigation by analysing several individual dubious articles, stressing questionable features: tortured writing style, citation of non-existent literature, and unacknowledged image reuse. Surprisingly, some websites offer to rewrite texts for free, generating gobbledegook full of tortured phrases. We believe some authors used rewritten texts to pad their manuscripts. We wish to raise the awareness on publications containing such questionable AI-generated or rewritten texts that passed (poor) peer review. Deception with synthetic texts threatens the integrity of the scientific literature.

arXiv.org
@ElisabethBik ends on a positive note: we need science to address the many issues which confront us (#climatechange #covid19 …), and it needs to be good science, so we should all play our part in making sure that science is good. #BC2basel
@marcrr @ElisabethBik @grndstt I can see here where native English speakers might gain some advantages - if they are at least checking the text generated. Non-native speakers without enough knowledge will fall into these traps much easier using LLMs.