Mark RubinJun 7, 2023

New Critical Metascience blog post:

"The preregistration prescriptiveness trade-off and unknown unknowns in science: Comments on Van Drimmelen (2023)”

https://markrubin.substack.com/p/the-preregistration-prescriptiveness

#Science
#OpenScience
#MetaScience2023
#CriticalMetascience
#Preregistration

The Preregistration Prescriptiveness Trade-Off and Unknown Unknowns in Science

I discuss Van Drimmelen’s (2023) Metascience2023 presentation on researchers’ decision making during the research process.

Critical Metascience
Mark RubinJun 7, 2023
New Critical Metascience blog post:

"The preregistration prescriptiveness trade-off and unknown unknowns in science: Comments on Van Drimmelen (2023)”

https://markrubin.substack.com/p/the-preregistration-prescriptiveness

#Science
#OpenScience
#MetaScience2023
#CriticalMetascience
#Preregistration
The Preregistration Prescriptiveness Trade-Off and Unknown Unknowns in Science

I discuss Van Drimmelen’s (2023) Metascience2023 presentation on researchers’ decision making during the research process.

Critical Metascience
David Colquhoun on BlueskyMay 14, 2023
It's a huge problem for metascience people -they are often the first people to criticise metrics -quite rightly, IMO. But they continually yield to the temptation to use them -bad, IMO
#Metascience2023
Joel ChanMay 11, 2023

Lovely/wistful to reflect on how much of my #chi2023 and #metascience2023 conference interactions were enriched by Twitter ("I know you from Twitter!").

Harder to do this if more and more of our online social interactions retreat to the "cozyweb" as the dark forest of the open social web gets darkened by enshittification.

Alex HolcombeMay 10, 2023
"THIS is my field's response to the replication crisis?!" Maybe I shouldn't have let Hugo tune in to #Metascience2023 – still trying to calm him down after @bethclarke's talk reporting that up to 2021, the rate of psychology papers that are primarily replications continues to be less than 1%.
DavidMellorMay 10, 2023
.@sortee is the only eco/evo society that gives awards for open science practices. not surprising but pretty lame that more don't follow their lead #Metascience2023 via Losia Lagisz
DavidMellorMay 10, 2023
Wow- it's really surprising that many journals impose time limits for post-pub critique on what they publish. This is unconscionable- I've never heard of a time limit for any other type of scientific discourse. via Tom Hardwicke
#Metascience2023 https://royalsocietypublishing.org/doi/10.1098/rsos.220139
Post-publication critique at top-ranked journals across scientific disciplines: a cross-sectional assessment of policies and practice | Royal Society Open Science

Journals exert considerable control over letters, commentaries and online comments that criticize prior research (post-publication critique). We assessed policies (Study One) and practice (Study Two) related to post-publication critique at 15 top-ranked ...

Royal Society Open Science
DavidMellorMay 10, 2023
The Institute for Replication is aiming to replicate nearly a quarter of polisci studies publishing in leading journals every year. Wants to make replication an expectation not the exception #metascience2023
Joel ChanMay 10, 2023

Rapid growth of paper mill papers (will track down claim in Q&A of ~20% of all papers from paper mills, I think from a metarxiv paper?), growth rate > number of papers overall, and retracted papers

This is pre-GPT!

#metascience2023

Joel ChanMay 10, 2023
Super Saiyan sighting in a #metascience2023 talk by Dashun Wang on career hot streaks!